-- Logs begin at Sat 2022-08-27 20:01:12 UTC, end at Sat 2022-08-27 20:59:33 UTC. -- Aug 27 20:31:46.679388 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 20:31:46.686870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 20:31:46 2022] *** Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: nodename: dv-osbrick-master-4-ceph Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: machine: x86_64 Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: clock source: unix Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: pcre jit disabled Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: detected number of CPU cores: 4 Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: current working directory: / Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: detected binary path: /usr/bin/uwsgi-core Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: your processes number limit is 47680 Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: your memory page size is 4096 bytes Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: detected max file descriptor number: 2048 Aug 27 20:31:46.688870 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: lock engine: pthread robust mutexes Aug 27 20:31:46.689725 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: thunder lock: enabled Aug 27 20:31:46.689725 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 20:31:46.689725 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 20:31:46.734682 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: Python main interpreter initialized at 0x5647214459c0 Aug 27 20:31:46.734682 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: python threads support enabled Aug 27 20:31:46.734682 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: your server socket listen backlog is limited to 100 connections Aug 27 20:31:46.734682 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: your mercy for graceful operations on workers is 90 seconds Aug 27 20:31:46.735083 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 20:31:46.735083 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: *** Operational MODE: preforking *** Aug 27 20:31:46.735390 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: *** uWSGI is running in multiple interpreter mode *** Aug 27 20:31:46.735390 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: spawned uWSGI master process (pid: 94805) Aug 27 20:31:46.735608 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 27 20:31:46.736292 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: spawned uWSGI worker 1 (pid: 94818, cores: 1) Aug 27 20:31:46.736478 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: spawned uWSGI worker 2 (pid: 94819, cores: 1) Aug 27 20:31:46.736629 dv-osbrick-master-4-ceph devstack@keystone.service[94805]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 20:31:51.286582 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:31:51.286582 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: from cryptography.utils import int_from_bytes Aug 27 20:31:51.287414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:31:51.287414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: from cryptography.utils import int_from_bytes Aug 27 20:31:51.287414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:31:51.287414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: from cryptography.utils import int_from_bytes Aug 27 20:31:51.287918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 20:31:51.287918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: from cryptography.utils import int_from_bytes Aug 27 20:31:51.336433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 20:31:51.336638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 20:31:51.336723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 20:31:51.336795 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 20:31:51.336853 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] command line args: [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 20:31:51.336915 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] command line args: [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 20:31:51.337048 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 20:31:51.337191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 20:31:51.337277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ================================================================================ {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 20:31:51.337358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ================================================================================ {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 20:31:51.337431 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] admin_token = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.337566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] admin_token = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.337690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] config_dir = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.337789 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] config_dir = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.337883 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.337971 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] config_source = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] config_source = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338309 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] debug = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] debug = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338832 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.338995 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339239 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339533 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339741 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339876 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_config_append = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.339967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_config_append = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340028 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_dir = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_dir = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_file = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_file = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.340968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341126 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341284 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341613 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341690 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.341756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342888 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.342962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343345 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.343805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.346797 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.346797 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.346957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] publish_errors = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] publish_errors = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347436 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347589 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347658 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347731 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347847 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.347939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348019 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348090 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] standard_threads = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348226 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] standard_threads = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348305 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348525 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348669 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] use_journal = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348857 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] use_journal = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.348926 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] use_json = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] use_json = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349070 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] use_stderr = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] use_stderr = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349306 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] use_syslog = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349400 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] use_syslog = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 20:31:51.349628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.349711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.349790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.349867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.349985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350089 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350286 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350735 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.350943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351050 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351128 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351417 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351568 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351568 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.351872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352018 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352437 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352437 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352560 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.352982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353210 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353286 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353641 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353778 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353911 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.353977 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354051 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354261 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354330 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354498 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.354892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355504 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.355971 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356184 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356260 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.356978 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357064 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357638 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.357972 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358109 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358590 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358840 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.358915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359104 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359676 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.359823 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360277 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360681 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.360964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361125 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361204 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361355 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361812 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.361901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362375 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362542 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.362853 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363085 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363268 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363348 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363502 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363581 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.363964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364282 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364510 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364887 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.364974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.365120 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.365197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.373562 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.373725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.373725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.373920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374317 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374484 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374638 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.374932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375218 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375333 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375853 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.375930 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376069 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376142 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376200 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376422 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376510 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376863 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.376977 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377125 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377306 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377380 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377658 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377730 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377807 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.377947 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378016 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378093 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378165 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378661 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378743 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.external = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.external = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.378969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379277 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.password = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.password = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] auth.token = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379568 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] auth.token = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.379935 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380082 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380159 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380383 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380452 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380598 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.380959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381179 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381306 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381452 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381523 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381593 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.381951 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382470 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382912 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.382982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383199 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383408 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383836 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.383980 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384260 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384901 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.384976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385046 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385334 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385555 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385634 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.385985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386061 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386132 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386305 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386408 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386511 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386669 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386877 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.386947 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387025 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387468 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387605 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387871 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.387949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388020 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388159 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388448 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388506 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388721 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388799 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.388945 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389219 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389365 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389502 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389502 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389637 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389778 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.389984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390637 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.390906 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391254 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391325 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391852 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.391960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392047 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392356 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392698 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392775 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.392984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393264 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393414 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.393878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394070 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394192 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394551 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394674 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.394835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395028 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395226 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395226 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395689 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.395979 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396340 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396797 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.396869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397065 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397293 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397522 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.397993 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398227 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398648 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.398929 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399011 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399261 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399643 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399724 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.399984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400117 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400589 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.400899 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401129 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401380 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401580 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.401989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402302 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402585 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402820 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.402976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403299 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403469 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403546 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.403943 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404172 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404246 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404398 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404476 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] role.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] role.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404873 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] role.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.404950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] role.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405099 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405176 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405833 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.405910 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406076 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406395 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406828 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.406905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407380 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.407872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408356 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408788 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.408943 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409439 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409683 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.409927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410013 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410405 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410504 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410681 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.410990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411676 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411843 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.411920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412179 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412336 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.412883 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413103 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413258 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413334 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413736 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.413971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414046 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414482 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414565 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414721 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.414962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415202 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415283 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415445 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415676 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415911 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.415987 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416382 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416729 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.416963 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417517 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.connection = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.connection = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.417927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418003 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418250 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418749 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.418980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419443 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419837 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.419914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420067 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420601 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.420853 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421082 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421247 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421325 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421473 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421785 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.421940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.422017 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 20:31:51.422108 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 20:31:51.422185 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 20:31:51.451409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.451627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.451804 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.451897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.451991 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.452215 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.460435 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.460757 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.489785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.489981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.490412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.490647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.541202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.541751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.589297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.589533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.591033 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.591263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.655876 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656042 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656489 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656857 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.656925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.657034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.679967 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680187 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680828 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.680929 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.681073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.681164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.681226 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.681286 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.681457 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.692260 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.692649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705858 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.705918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.706088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.706211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.706281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.706342 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.706496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.706609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 20:31:51.723644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.723892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 20:31:51.724013 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.724185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.724308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 20:31:51.724397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 20:31:51.724567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.724691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.724759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 20:31:51.724866 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.725044 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.725136 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.725319 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.725440 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.725508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.725785 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.734884 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735284 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735435 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.735985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.742628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.742897 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.745491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.745808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.745934 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746089 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746628 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.746915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747038 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747208 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747333 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747442 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747534 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747875 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.747983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.748074 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.748281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.748407 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.748529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.772926 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.773167 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.774399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.774539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.774707 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.774916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.779348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.779469 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.779618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.779746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.779918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.780044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.786266 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.786462 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.786560 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.786778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.790700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.790828 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.790996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791634 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791834 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.791960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.792128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.792253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.792413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.792613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.792753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.792879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.808222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.808348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.808469 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.808563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.812344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.812489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.815425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.815552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.815706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.815829 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.820073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.820196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.823188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.823311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.826311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.826493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.826636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.826768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.826890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.826979 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.827276 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.827410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.827529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.827621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.827836 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.827979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.843823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.843948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.844107 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.844234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.844351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.844462 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.844629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.844753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.851339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.851466 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.852971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.853150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.854530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.854656 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.854808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.854933 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.857461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.857586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.857736 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.857861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.858028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.858166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.858282 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.858372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.858624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.858753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.869688 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.869815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.869932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870024 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870534 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870818 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.870908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.871121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.871245 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.871404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.871535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.886729 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.886965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.889688 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.889812 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.892649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.892805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.894127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.894244 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.896059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.896192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.896285 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.896351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.896412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.896485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.902560 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.902706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.904035 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.904162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.906882 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.907028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.907156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.907478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.907762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.908204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.908504 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.908795 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.916526 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.916652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.916814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.916938 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.917097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.917240 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.924027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.924155 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 20:31:51.924311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.924455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.924560 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.924637 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.924850 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.924981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.925961 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926086 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926362 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.926806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.927040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.927166 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.927265 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.927342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.927563 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.927690 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 20:31:51.960163 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5647214459c0 pid: 94819 (default app) Aug 27 20:31:51.960293 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5647214459c0 pid: 94818 (default app) Aug 27 20:31:51.963659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751aa27-6be0-4692-a5a2-cefe8dfba28c None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:31:51.963944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751aa27-6be0-4692-a5a2-cefe8dfba28c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:31:51.964214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751aa27-6be0-4692-a5a2-cefe8dfba28c None None] PATH_INFO: `/v3` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:31:51.968766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Sat Aug 27 20:31:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:31:59.019738 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:31:59.020292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:31:59.020292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:31:59.024634 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:31:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:31:59.031073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:31:59.032029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:31:59.032029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:31:59.118718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: INFO dbcounter [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] Registered counter for database keystone Aug 27 20:31:59.139806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG oslo_db.sqlalchemy.engines [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:31:59.150653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writer thread running {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:31:59.334520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG passlib.handlers.bcrypt [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94819) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 20:31:59.334942 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG passlib.handlers.bcrypt [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94819) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 20:31:59.390635 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:31:59.393718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:31:59.545664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:31:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 27 20:32:00.146675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:00.231908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: INFO dbcounter [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] Registered counter for database keystone Aug 27 20:32:00.255757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG oslo_db.sqlalchemy.engines [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 20:32:00.266786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writer thread running {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 20:32:00.393765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5db794-785f-4fe9-8b61-0b442b246e72 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:00.403262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:00.404199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:00.404618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:00.405026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:00.418381 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:00.478666 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 20:32:00.479011 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394f167-80fa-4778-86cb-35550e8cfef6 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:00.490026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Sat Aug 27 20:32:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 20:32:00.498049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:00.515137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcafb5-eef7-4c58-bed8-81f6643a002c None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:00.521711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:00.522870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:00.523151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:00.523419 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] PATH_INFO: `/v3/projects/fff777f39d5941018014cff100fff5ca` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:00.525099 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] RBAC: Authorizing `identity:get_project(project_id=fff777f39d5941018014cff100fff5ca)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:00.575204 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 20:32:00.575528 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109ee3-07d4-4528-b824-4cc843e68f34 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:00.580290 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Sat Aug 27 20:32:00 2022] GET /identity/v3/projects/fff777f39d5941018014cff100fff5ca => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:02.717526 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe152e-ef04-4088-9975-872ec20987a6 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:02.718095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe152e-ef04-4088-9975-872ec20987a6 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:02.718095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe152e-ef04-4088-9975-872ec20987a6 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:02.722223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:02.729014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:02.729684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:02.729963 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:02.757353 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:02.758949 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:02.769017 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 27 20:32:03.090684 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe152e-ef04-4088-9975-872ec20987a6 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:03.105803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe152e-ef04-4088-9975-872ec20987a6 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:03.111190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6747f-691b-48d3-b4de-9cc490c79e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:03.111786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6747f-691b-48d3-b4de-9cc490c79e7e admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:03.112061 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6747f-691b-48d3-b4de-9cc490c79e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:03.112328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6747f-691b-48d3-b4de-9cc490c79e7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:03.121063 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6747f-691b-48d3-b4de-9cc490c79e7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:03.122877 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6747f-691b-48d3-b4de-9cc490c79e7e admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:03.132232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Sat Aug 27 20:32:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 20:32:03.138495 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:03.153934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b798a04-3d8e-4b70-9f98-2efbd609fb5b None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:03.163159 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a326782-bf64-406e-9621-fa950dbce826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:03.164078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a326782-bf64-406e-9621-fa950dbce826 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:03.164451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a326782-bf64-406e-9621-fa950dbce826 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:03.164809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a326782-bf64-406e-9621-fa950dbce826 admin admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:03.167274 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a326782-bf64-406e-9621-fa950dbce826 admin admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:03.169143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a326782-bf64-406e-9621-fa950dbce826 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:03.170704 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Sat Aug 27 20:32:03 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:05.394362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6acae1-246c-44a9-a2de-e1a5381078ff None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:05.394960 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6acae1-246c-44a9-a2de-e1a5381078ff None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:05.394960 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6acae1-246c-44a9-a2de-e1a5381078ff None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:05.396265 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:05.401653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:05.402045 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:05.402200 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:05.412574 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e934-a8f6-4821-ace4-37be6dbc6668 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:05.412853 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e934-a8f6-4821-ace4-37be6dbc6668 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:05.413121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e934-a8f6-4821-ace4-37be6dbc6668 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:05.414388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:05.420434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:05.420705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:05.420970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:05.421281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:05.422485 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:05.461802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG passlib.handlers.bcrypt [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=94818) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 20:32:05.462256 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG passlib.handlers.bcrypt [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94818) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 20:32:05.508054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:05.509677 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:05.617021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:05.628040 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:05.944404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:05.945784 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:05.969343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.049187 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.052075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7d0ed-b28a-43d5-a833-9f000f299075 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.052535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b96a-785a-473e-a1ce-b94637935624 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.087308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.087928 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.088207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.088374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.088475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.089525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.089804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.090074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.102621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:06.111298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:06.112397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:06.113448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:06.114791 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 8/14] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:06.118308 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:06.158497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.159932 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.183741 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.219075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e7b42-dbec-40f0-96c8-d0491520ebe3 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.252527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.253132 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.253406 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.253679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.254349 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:06.254673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.256128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.261201 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:32:06.266900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:06.267804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:06.273215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:06.297222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.363308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3971f-1a7b-45a0-96d0-07cb82a40e9b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.374592 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd37525-26e3-4327-b13c-d0ceec9126e5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.386458 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.398832 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.399492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.399769 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.400039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.412216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.413640 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:32:06.433830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:06.435063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:32:06.440925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:32:06.440925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:32:06.440925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:06.440925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 8/17] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:06.441263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:06.522650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.523287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.523568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.523838 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.525298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.526865 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.528423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:06 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:06.533872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:06.546749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbc7d5-3d93-4759-a9cf-bd6e0349693d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.582382 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.583023 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.583298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.583562 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.584215 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:06.584513 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.585924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.603039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:06.628549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.640970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63270-588b-4d00-9993-a4d3460e257c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.679201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81880eec-43b8-4536-bcfb-3a34ed4c5f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.679751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880eec-43b8-4536-bcfb-3a34ed4c5f2e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.680050 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880eec-43b8-4536-bcfb-3a34ed4c5f2e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.680323 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81880eec-43b8-4536-bcfb-3a34ed4c5f2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.681515 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880eec-43b8-4536-bcfb-3a34ed4c5f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.683085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81880eec-43b8-4536-bcfb-3a34ed4c5f2e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.684694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:06.691012 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:06.727203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:06.801671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53094c52-8cf8-4c4c-8f4f-be9c78a65f0b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:06.835775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:06.836395 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:06.836664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:06.836934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:06.837673 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.domain.id=default, user.id=38d5d95ae1f34880b821c1d52307fcc4) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:06.837980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:06.839533 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b62208-df5e-4eb3-af7f-9892e1a0ad57 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:06.847188 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1322 bytes} [Sat Aug 27 20:32:06 2022] GET /identity/v3/role_assignments?user.id=38d5d95ae1f34880b821c1d52307fcc4&scope.domain.id=default&role.id=0f13813da5a84a44829df58f1d837465 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:09.229494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239bc75-67c8-4a66-b897-2e089e3ea4f6 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.230004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239bc75-67c8-4a66-b897-2e089e3ea4f6 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.230004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239bc75-67c8-4a66-b897-2e089e3ea4f6 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.231379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:09.243793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515959e2-6a6d-485c-8d73-608bdabe80d6 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.244668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515959e2-6a6d-485c-8d73-608bdabe80d6 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.245170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515959e2-6a6d-485c-8d73-608bdabe80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.271689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-515959e2-6a6d-485c-8d73-608bdabe80d6 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:09.273294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-515959e2-6a6d-485c-8d73-608bdabe80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:09.370814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:09.405003 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83b921-ccbc-40d2-abac-4d9f01dd86b9 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.405640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83b921-ccbc-40d2-abac-4d9f01dd86b9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.406147 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83b921-ccbc-40d2-abac-4d9f01dd86b9 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.407734 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:09.413981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cd2d1-7259-4373-b4c8-2433e882a1e9 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.414270 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cd2d1-7259-4373-b4c8-2433e882a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.414574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cd2d1-7259-4373-b4c8-2433e882a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.443503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-656cd2d1-7259-4373-b4c8-2433e882a1e9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:09.444722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-656cd2d1-7259-4373-b4c8-2433e882a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:09.474866 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:09.544459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:09.639543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e3665-6302-44b5-a063-8f79a1c6e86c None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.640177 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e3665-6302-44b5-a063-8f79a1c6e86c None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.640653 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e3665-6302-44b5-a063-8f79a1c6e86c None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.642176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:09.647584 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.648136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.648607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.673181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:09.674854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:09.763972 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a9c87-c184-4566-aca8-94d1031e8a03 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.764598 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a9c87-c184-4566-aca8-94d1031e8a03 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.765086 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a9c87-c184-4566-aca8-94d1031e8a03 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.766649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 15/27] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:09.770587 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 13/28] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:09.772906 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:09.773391 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:09.773855 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:09.806650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:09.808195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:09.912674 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:09.976515 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.063915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.075003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:10.103478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be9e3-466a-4035-aea3-f8fccaa00c62 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.165722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:10.166359 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:10.166715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:10.166989 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:10.191898 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:10.205547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:10.206399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:10.207190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:10.209860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 14/30] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:10.217621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:10.219757 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.244372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18868d-d0f9-45fd-b952-634a9723767d None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.321681 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:10.322252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:10.322615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:10.322917 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:10.353995 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:10.355609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:32:10.379436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:10.380438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:32:10.381228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:32:10.381228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:32:10.381228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:10.381228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 17/31] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:10.386595 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.394740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683dbaa-9dea-4bbf-8f91-eacc7c867f9e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.430860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:10.431471 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:10.431747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:10.432018 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:10.432897 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] RBAC: Adding query filter params (name=admin) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:10.433202 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:10.434635 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:10.449823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 15/32] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:10.451156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.463843 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:10.502968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfafc8-3252-4a0c-b593-d34abf59af58 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.553240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:10.554313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:10.554768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:10.555350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:10.556576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:10.558709 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:10.563409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142b085-5bbf-4e10-8286-3f8067cfd01f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.581092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:10.611275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:10.612352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:10.613087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:10.613588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:10.614591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:10.616462 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:10.709722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 18/33] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 27 20:32:10 2022] POST /identity/v3/roles => generated 225 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:10.714900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.761106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 16/34] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 27 20:32:10 2022] POST /identity/v3/roles => generated 219 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:10.762549 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:10.883174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced41f1-b1ca-41e7-b646-994af6634b06 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.887010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:10.949088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6f912-98d1-41dc-9341-104483ab1d2b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:10.964677 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:10.965321 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:10.965601 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:10.965877 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:10.966937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:10.967244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:10.968817 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbf6fe-0458-479a-a478-70c595d6a7bc None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.003573 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 19/35] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:11.004996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5bfc-2402-449b-a2ce-c1506b9538ee None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.005281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5bfc-2402-449b-a2ce-c1506b9538ee None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.005558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5bfc-2402-449b-a2ce-c1506b9538ee None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.006845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 20/36] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:11.018138 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5bfc-2402-449b-a2ce-c1506b9538ee None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:11.026396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b88a7-939f-4798-9b25-ae8a9caba5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.027101 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b88a7-939f-4798-9b25-ae8a9caba5f6 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.027408 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b88a7-939f-4798-9b25-ae8a9caba5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.027682 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b88a7-939f-4798-9b25-ae8a9caba5f6 None admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.032945 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b88a7-939f-4798-9b25-ae8a9caba5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.033467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b88a7-939f-4798-9b25-ae8a9caba5f6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.038479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 17/37] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:10 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:11.038479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.038479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.038479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.058340 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:11.060070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:11.101305 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:11.154179 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 18/38] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:11.155030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:11.159785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5bfc-2402-449b-a2ce-c1506b9538ee None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:11.197179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de048d6-11dd-4a1d-be1b-e5ffbb93121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.197828 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de048d6-11dd-4a1d-be1b-e5ffbb93121b None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.198109 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de048d6-11dd-4a1d-be1b-e5ffbb93121b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.198383 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de048d6-11dd-4a1d-be1b-e5ffbb93121b None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.199094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de048d6-11dd-4a1d-be1b-e5ffbb93121b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.200549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de048d6-11dd-4a1d-be1b-e5ffbb93121b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.227285 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:11.242843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 21/39] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:32:11 2022] POST /identity/v3/projects => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:11.244165 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d9b5-06c6-44a2-90e4-0289638025aa None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.244453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d9b5-06c6-44a2-90e4-0289638025aa None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.245083 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d9b5-06c6-44a2-90e4-0289638025aa None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.246419 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 22/40] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:11.252624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.253227 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.254176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.271620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca8fe7-8618-4652-9943-77f8e6c54e2f None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:11.284127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:11.287136 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:11.316328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.316772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.317045 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.318746 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.318849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.320374 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.322530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 19/41] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:11.329196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:11.404457 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 23/42] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:11.461480 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34c5bf-582c-4a3c-9f12-37e872143d00 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:11.484066 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:11.496606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.497327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.497604 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.497883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] PATH_INFO: `/v3/domains/default/users/38d5d95ae1f34880b821c1d52307fcc4/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.500092 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=38d5d95ae1f34880b821c1d52307fcc4, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.501685 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.507240 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:11.522837 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 20/43] 10.222.0.15 () {58 vars in 1361 bytes} [Sat Aug 27 20:32:11 2022] PUT /identity/v3/domains/default/users/38d5d95ae1f34880b821c1d52307fcc4/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 20:32:11.539384 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:11.605696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cc13e-e79b-4512-bef8-faa8f2044e61 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:11.642657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.643315 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.643591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.643862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.646514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.648290 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 24/44] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:11.653973 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:11.727531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:11.767776 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9830f-81f8-49b3-8c06-a29962ca004d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:11.802455 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036aae8-eee2-4775-8ce7-1e85705793a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.803138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036aae8-eee2-4775-8ce7-1e85705793a6 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.803354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036aae8-eee2-4775-8ce7-1e85705793a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.803619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036aae8-eee2-4775-8ce7-1e85705793a6 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.804328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036aae8-eee2-4775-8ce7-1e85705793a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.805741 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036aae8-eee2-4775-8ce7-1e85705793a6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.837130 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 21/45] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:32:11 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:11.846704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173c90-4726-4eed-88fb-a709a88d28b9 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:11.856233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:11.883277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f2ea-86e1-4b4d-a5ca-e62a3cabf54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:11.884058 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f2ea-86e1-4b4d-a5ca-e62a3cabf54d None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:11.886671 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f2ea-86e1-4b4d-a5ca-e62a3cabf54d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:11.886671 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f2ea-86e1-4b4d-a5ca-e62a3cabf54d None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:11.886671 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f2ea-86e1-4b4d-a5ca-e62a3cabf54d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:11.887337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f2ea-86e1-4b4d-a5ca-e62a3cabf54d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:11.909882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 25/46] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 27 20:32:11 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:32:13.683626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54ec1f-0cdf-44cb-ab09-5040a3e1c0e3 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:13.684203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54ec1f-0cdf-44cb-ab09-5040a3e1c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:13.684203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54ec1f-0cdf-44cb-ab09-5040a3e1c0e3 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:13.685521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 22/47] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:13.690755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cac87-8bb3-4c43-8c01-976cfb73a141 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:13.691189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cac87-8bb3-4c43-8c01-976cfb73a141 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:13.691271 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cac87-8bb3-4c43-8c01-976cfb73a141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:13.709459 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-072cac87-8bb3-4c43-8c01-976cfb73a141 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:13.710683 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-072cac87-8bb3-4c43-8c01-976cfb73a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:13.783481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 26/48] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:14.004936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0853-f84c-48b1-af78-73534adba26d None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.005185 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0853-f84c-48b1-af78-73534adba26d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.005453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a0853-f84c-48b1-af78-73534adba26d None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.006856 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 23/49] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:14.012253 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.012540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.012810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.031890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:14.033094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:14.100516 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 27/50] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:14.104077 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0853-f84c-48b1-af78-73534adba26d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.158759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:14.212325 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a0853-f84c-48b1-af78-73534adba26d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.247223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.247845 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.248122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.248381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.258969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:14.263702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:14.264671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:14.265438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 24/51] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:14.270860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.303364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:14.373183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c030a-dcb7-4e5d-a58b-5a133db6a0ac None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.408984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.409606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.409891 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.410161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.410869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:14.411171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:14.412571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:14.421479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 28/52] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:14.427181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.428132 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.519158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:14.528556 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267610a2-015c-4023-919a-ba3baf31b6fb None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.529194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2005f-7fb0-4d8e-ac7d-299c39d866bb None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.537655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:14.562114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.562777 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.563043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.563179 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.563316 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.563673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.563947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.564215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.564445 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:14.565456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:14.565937 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:14.566935 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:14.567566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 25/53] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:14 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:14.568517 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 29/54] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:14.573426 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.573983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.670934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1858c9-0349-4074-afd6-3390bc1f7517 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.674173 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0271-9862-4d0d-be2a-09b4f12b3ba2 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.703745 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.704378 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.704650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.704920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.706016 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:14.707008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecb9b-5dfe-4bbd-8a4e-33e2db761440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.707503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:14.707610 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecb9b-5dfe-4bbd-8a4e-33e2db761440 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.707875 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecb9b-5dfe-4bbd-8a4e-33e2db761440 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.708146 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecb9b-5dfe-4bbd-8a4e-33e2db761440 None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.708793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ecb9b-5dfe-4bbd-8a4e-33e2db761440 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:14.709063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:14.710215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ecb9b-5dfe-4bbd-8a4e-33e2db761440 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:14.714878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:14.739614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 30/56] 10.222.0.15 () {60 vars in 1140 bytes} [Sat Aug 27 20:32:14 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:14.762559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:14.823119 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9814b-7650-4c14-aba4-65922e965f84 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:14.859699 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:14.860314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:14.860591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:14.860859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:14.861597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.domain.id=default, user.id=38d5d95ae1f34880b821c1d52307fcc4) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:14.861899 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:14.863418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d911fe-b5e6-4e79-8aa7-a71d1b409e8b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:14.870085 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 27/57] 10.222.0.15 () {56 vars in 1322 bytes} [Sat Aug 27 20:32:14 2022] GET /identity/v3/role_assignments?user.id=38d5d95ae1f34880b821c1d52307fcc4&scope.domain.id=default&role.id=0f13813da5a84a44829df58f1d837465 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:16.949734 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296088-63f6-4a66-9173-8ed1fbc7f118 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:16.950205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296088-63f6-4a66-9173-8ed1fbc7f118 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:16.950287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66296088-63f6-4a66-9173-8ed1fbc7f118 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:16.951661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:16.957950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:16.958706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:16.958841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:16.979418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:16.980615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:17.049886 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:17.367655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296088-63f6-4a66-9173-8ed1fbc7f118 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:17.384682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:17.482581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66296088-63f6-4a66-9173-8ed1fbc7f118 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:17.517048 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff9e29-a852-4b42-b72c-a76bfd66cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:17.517665 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9e29-a852-4b42-b72c-a76bfd66cde0 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:17.517943 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9e29-a852-4b42-b72c-a76bfd66cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:17.518209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff9e29-a852-4b42-b72c-a76bfd66cde0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:17.519404 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff9e29-a852-4b42-b72c-a76bfd66cde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:17.520844 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff9e29-a852-4b42-b72c-a76bfd66cde0 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:17.522417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:17.528804 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:17.573124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:17.638944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a142f0c-0ba6-4dfb-b585-00911d4cebec None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:17.674944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eca258-6c94-408d-b926-7a4c719efa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:17.675530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eca258-6c94-408d-b926-7a4c719efa62 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:17.675802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eca258-6c94-408d-b926-7a4c719efa62 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:17.676065 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eca258-6c94-408d-b926-7a4c719efa62 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:17.676706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eca258-6c94-408d-b926-7a4c719efa62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:17.678149 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eca258-6c94-408d-b926-7a4c719efa62 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:17.711324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:17 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:20.953571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c776d-1108-4bb3-9095-37353c2545df None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:20.954592 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c776d-1108-4bb3-9095-37353c2545df None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:20.955090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c776d-1108-4bb3-9095-37353c2545df None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:20.956645 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:20.962161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b575-8e85-494f-be4f-7e9eb2f708b2 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:20.963136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b575-8e85-494f-be4f-7e9eb2f708b2 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:20.963650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b575-8e85-494f-be4f-7e9eb2f708b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:20.991454 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-bf85b575-8e85-494f-be4f-7e9eb2f708b2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:20.993021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-bf85b575-8e85-494f-be4f-7e9eb2f708b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:21.079786 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:21.123321 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bf5b2-b841-42ef-a744-096dee06aed9 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.123952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bf5b2-b841-42ef-a744-096dee06aed9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.124461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bf5b2-b841-42ef-a744-096dee06aed9 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.126068 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 34/64] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:21.144336 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928c889-1770-4b6c-b128-8c0598534fa1 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.144952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928c889-1770-4b6c-b128-8c0598534fa1 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.145418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928c889-1770-4b6c-b128-8c0598534fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.175547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2928c889-1770-4b6c-b128-8c0598534fa1 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:21.177047 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2928c889-1770-4b6c-b128-8c0598534fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:21.195884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:21.271792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:21.302314 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fe53-4d4f-427a-84d8-09e03a1168ca None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.302961 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fe53-4d4f-427a-84d8-09e03a1168ca None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.303448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59fe53-4d4f-427a-84d8-09e03a1168ca None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.304978 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 35/66] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:21.310622 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935ee89-d01f-4124-ada5-274a4b94e4cd None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.310913 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935ee89-d01f-4124-ada5-274a4b94e4cd None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.311191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935ee89-d01f-4124-ada5-274a4b94e4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.347540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c935ee89-d01f-4124-ada5-274a4b94e4cd None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:21.348780 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c935ee89-d01f-4124-ada5-274a4b94e4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:21.423498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fe53-4d4f-427a-84d8-09e03a1168ca None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:21.457819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 32/67] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:21.542402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:21.567168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59fe53-4d4f-427a-84d8-09e03a1168ca None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:21.575153 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721899-f0cc-4ae8-94f3-ecdad3c45177 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.575685 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721899-f0cc-4ae8-94f3-ecdad3c45177 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.576142 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e721899-f0cc-4ae8-94f3-ecdad3c45177 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.577694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 33/68] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:21.582842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.583353 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.583809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.611156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:21.612673 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:21.636174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:21.637326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.639137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.639600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.664262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:21.671310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:21.672155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:21.672916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:21.675170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 36/69] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:32:21.681485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:21.763087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 34/70] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:21.795892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:21.824446 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:21.866176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c4fa6-4ac7-4f0d-81c8-dbb5dbb01945 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:21.913814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:21.914467 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.914765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.915041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.915715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:21.916045 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:21.917465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:21.925921 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 37/71] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:21.926982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:21.929544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:21.936707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e00aa4-e126-4f46-9a79-e9a83876d88f None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:21.973265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c637-e7a6-40c7-b9df-02f13b482e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:21.973982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c637-e7a6-40c7-b9df-02f13b482e1b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.974469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c637-e7a6-40c7-b9df-02f13b482e1b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.974909 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c637-e7a6-40c7-b9df-02f13b482e1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.986113 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c637-e7a6-40c7-b9df-02f13b482e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-8da6c637-e7a6-40c7-b9df-02f13b482e1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:21.991118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:21.991965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:21.993095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 35/72] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:32:21.994803 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0d0f-92a4-4bed-9ac5-43f9507fdfe0 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:21.995095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0d0f-92a4-4bed-9ac5-43f9507fdfe0 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:21.995371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0d0f-92a4-4bed-9ac5-43f9507fdfe0 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:21.996628 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 36/73] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:22.001020 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0d0f-92a4-4bed-9ac5-43f9507fdfe0 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.039805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed2739-b24e-4e3b-954f-03175ffc8390 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.073805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.074587 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.074870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.075148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.085242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:22.088705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:22.092170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:22.093211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:22.094150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 38/74] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:32:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:22.095293 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.117309 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0d0f-92a4-4bed-9ac5-43f9507fdfe0 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.151112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d07f3-d80f-4347-8586-01cf40f27d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.151750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d07f3-d80f-4347-8586-01cf40f27d0d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.152025 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d07f3-d80f-4347-8586-01cf40f27d0d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.152288 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d07f3-d80f-4347-8586-01cf40f27d0d None admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.153429 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d07f3-d80f-4347-8586-01cf40f27d0d None admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.153749 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.154981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d07f3-d80f-4347-8586-01cf40f27d0d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.157167 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:21 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.158433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.158723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.158998 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.175916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:22.177113 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:22.195046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27490af-03a3-405c-8fb5-08c8b67d4573 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.229070 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.229667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.229944 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.230199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.230882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] RBAC: Adding query filter params (name=member) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:22.231185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.232555 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.240802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 39/76] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.241363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.243772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 38/77] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:22.244578 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.324223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.348970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ba69f-2dd6-4d8e-a3c4-cfca3c536c7d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.356307 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9142-39ca-4716-88f7-6cd6fec5fdf5 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.374398 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.385807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.386453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.386745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.387015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.393220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.393832 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.394107 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.394377 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.395088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:22.395386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.396775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.397455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:22.403358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:22.404262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:22.407387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 40/78] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:22.408016 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 39/79] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.408016 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.410022 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.509711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0ae37-48c5-46ce-ba49-ccfd3d21f9ac None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.512150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb196de-7466-4f0b-848b-96ed507029a7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.543957 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.544751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.545096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.545440 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.547150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.547721 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.547819 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.548012 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.548278 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.560368 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.561955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.563815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 40/80] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.564449 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.606730 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.621925 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.623539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.664369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159912-88c7-41c5-b99c-bd7580976448 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.698013 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.698680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.698953 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.699218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.700434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.701911 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.703544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 41/81] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.704298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.727895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 41/82] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:22.728825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.770115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.812570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.812752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d869d-7f6e-4638-a4e5-3ddfdda0be6f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.828607 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe3c41-9fc1-46c9-bd7f-11e6c0fdba37 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.847755 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.848363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.848665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.848929 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.849601 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:22.849907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.851342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.859374 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.859934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:22.866532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.867147 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.867425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.867694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.936644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.938110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.958164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b9e3-1d4e-4eb1-9784-9dc15e500f2f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:22.979799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:22.992279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:22.992909 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:22.993182 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:22.993446 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:22.994623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:22.996064 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:22.997606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 43/84] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:22.998359 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.020846 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.037573 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:23.038739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.099654 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02e37f-d613-45ff-924f-a33866b188bc None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.131721 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.132259 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.132574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.132836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.141635 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc4ff4-067a-4734-9305-d929b5932161 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.175274 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.175900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.176178 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.176450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.177669 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.179207 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.180840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 43/86] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:23.185616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.191581 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.202477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.203931 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.238756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.284261 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38a39f-59b8-414b-a344-f4b0c5c026c9 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.303983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 44/87] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:23.307345 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.317181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.317815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.318089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.318356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.319558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.321030 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.322683 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:23.323460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.397101 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.407748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a14d3-3b9f-4f89-b88c-61dd2ee7242b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.418992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe64fe-d39e-407f-95f2-0ad92b839651 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.439376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.443866 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.444466 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.444740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.445003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.445646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.447141 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.454038 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.454699 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.454974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.455243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.456384 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.457821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.459488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 45/89] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:23.460244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.469087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 45/90] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:23 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:23.469913 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.582529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ee79d-4303-47ff-9302-a4b52da0e4a8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.582725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192471d9-0f0c-4cf9-96e8-0a4d7a605c99 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.619371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.619785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.620059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.620338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.620456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.620624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.620714 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.620928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.621671 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=38d5d95ae1f34880b821c1d52307fcc4) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:23.621778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.621978 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.623272 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.623455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.624955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:23.625746 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.633104 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/role_assignments?user.id=38d5d95ae1f34880b821c1d52307fcc4&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=0f13813da5a84a44829df58f1d837465 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:23.633971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.649887 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.718278 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:23.762744 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62844f14-fa4e-40d2-8ced-0f86fea3a2e8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.786361 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632098a-ef65-45d4-919b-7c8a7d761a01 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:23.822287 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.823494 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.823494 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.823494 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.848383 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:23.848997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:23.849277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:23.849548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:23.850285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=e41f3e4d789846bd8210f42df0a1bb8c) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:23.850655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.852107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.857811 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/role_assignments?user.id=e41f3e4d789846bd8210f42df0a1bb8c&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=ea04e85c0aa7408095b855be56c86503 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:23.858751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:23.929179 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:23.931078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:23.949867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:24.000520 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caacd1-85fe-4deb-9f79-4d5611fef207 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:24.024250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:24.047159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:24.047850 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:24.048144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:24.048420 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:24.049184 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] RBAC: Adding query filter params (role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=e41f3e4d789846bd8210f42df0a1bb8c) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:24.049541 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:24.051082 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:24.057623 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 48/94] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/role_assignments?user.id=e41f3e4d789846bd8210f42df0a1bb8c&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=d8b807df19b642feae1864b059dea9cf => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:24.109472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 47/95] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:24.114962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:24.300123 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841820d8-c77b-41e1-9028-be91d4708c8d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:24.346312 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01469f-a67d-411b-a389-97d5e86e73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:24.346981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01469f-a67d-411b-a389-97d5e86e73d5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:24.347252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01469f-a67d-411b-a389-97d5e86e73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:24.347518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01469f-a67d-411b-a389-97d5e86e73d5 None admin] PATH_INFO: `/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:24.348682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01469f-a67d-411b-a389-97d5e86e73d5 None admin] RBAC: Authorizing `identity:get_project(project_id=fb0d66b2868e4cc2834d428bf0e0f3df)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:24.350144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01469f-a67d-411b-a389-97d5e86e73d5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:24.352063 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 49/96] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:24 2022] GET /identity/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:24.357856 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:24.507044 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df109-30b6-48b1-8c0a-68ec88dceb1d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:24.527516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:24.550561 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:24.551085 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:24.551368 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:24.551638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:24.552370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=fb0d66b2868e4cc2834d428bf0e0f3df, user.id=e41f3e4d789846bd8210f42df0a1bb8c) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:24.552674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:24.554186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304bf2-56e9-48bc-8a05-1fe0233b3df7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:24.562361 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 48/97] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:24 2022] GET /identity/v3/role_assignments?user.id=e41f3e4d789846bd8210f42df0a1bb8c&scope.project.id=fb0d66b2868e4cc2834d428bf0e0f3df&role.id=ea04e85c0aa7408095b855be56c86503 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:26.398575 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ece6-a5d5-44c4-a61d-14de71fc897b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:26.399577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ece6-a5d5-44c4-a61d-14de71fc897b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:26.400056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9ece6-a5d5-44c4-a61d-14de71fc897b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:26.401643 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 50/98] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:26.407189 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc341-a3c0-4452-87a1-72dde177fe34 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:26.408054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc341-a3c0-4452-87a1-72dde177fe34 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:26.408534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc341-a3c0-4452-87a1-72dde177fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:26.427213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-476dc341-a3c0-4452-87a1-72dde177fe34 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:26.428735 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-476dc341-a3c0-4452-87a1-72dde177fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:26.498975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 49/99] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:26.683731 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e275-f0ee-4a47-831a-521cac695605 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:26.684378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e275-f0ee-4a47-831a-521cac695605 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:26.684858 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e275-f0ee-4a47-831a-521cac695605 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:26.686405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 51/100] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:26.691973 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff041-b5db-4784-a809-bd50f155fbda None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:26.692530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff041-b5db-4784-a809-bd50f155fbda None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:26.693014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff041-b5db-4784-a809-bd50f155fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:26.719370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-6b8ff041-b5db-4784-a809-bd50f155fbda None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:26.720590 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-6b8ff041-b5db-4784-a809-bd50f155fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:26.811795 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 50/101] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:27.008463 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e275-f0ee-4a47-831a-521cac695605 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.048687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895af8dc-cb49-409b-8ea2-8931a3fe9aa8 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.049298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895af8dc-cb49-409b-8ea2-8931a3fe9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.049764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895af8dc-cb49-409b-8ea2-8931a3fe9aa8 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.051357 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 51/102] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:27.056728 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade949e-71c5-4a05-b4f2-c154d4b1ac8d None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.057231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade949e-71c5-4a05-b4f2-c154d4b1ac8d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.057701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade949e-71c5-4a05-b4f2-c154d4b1ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.069392 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:27.095077 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-fade949e-71c5-4a05-b4f2-c154d4b1ac8d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:27.096655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-fade949e-71c5-4a05-b4f2-c154d4b1ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:27.128860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e275-f0ee-4a47-831a-521cac695605 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:27.167636 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:27.168540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.168962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.169618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.178753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:27.181584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:27.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:27.188277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:27.189018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:27.191121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:27.197049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.264763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 52/104] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:27.279224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e76cf-a8da-4e19-934d-ab69aa3c2f37 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.279713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e76cf-a8da-4e19-934d-ab69aa3c2f37 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.280125 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e76cf-a8da-4e19-934d-ab69aa3c2f37 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.281621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 53/105] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:27.287694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.288131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.288540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.335492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b940-02c1-45cf-8d2b-2ec58987771d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:27.339501 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:27.341361 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:27.362387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:27.383658 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:27.384281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.384619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.384892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.385569 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:27.385870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:27.389811 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:27.408829 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 53/106] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:27.409705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.468238 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:27.468944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.575867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67233-861c-44a8-9ab2-9679b7c9dc97 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:27.586830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:27.634633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e04f0b-6da1-47dd-ab27-6d5d539de785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:27.638389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e04f0b-6da1-47dd-ab27-6d5d539de785 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.639810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e04f0b-6da1-47dd-ab27-6d5d539de785 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.640540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e04f0b-6da1-47dd-ab27-6d5d539de785 None admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.643982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e04f0b-6da1-47dd-ab27-6d5d539de785 None admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:27.646288 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e04f0b-6da1-47dd-ab27-6d5d539de785 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:27.648269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 55/108] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:27.655914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49c39-9a7d-4777-a349-b3999be8afe3 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.657131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49c39-9a7d-4777-a349-b3999be8afe3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.657750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f49c39-9a7d-4777-a349-b3999be8afe3 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.660402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 56/109] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:27.662028 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49c39-9a7d-4777-a349-b3999be8afe3 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.669534 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419eca4-30f0-4c4d-8e35-e0d1cd15903d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:27.732080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3f9c1-d5f4-495e-8751-c6aef77be516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:27.732711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3f9c1-d5f4-495e-8751-c6aef77be516 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.733000 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3f9c1-d5f4-495e-8751-c6aef77be516 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.733263 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3f9c1-d5f4-495e-8751-c6aef77be516 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.754853 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3f9c1-d5f4-495e-8751-c6aef77be516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-59a3f9c1-d5f4-495e-8751-c6aef77be516 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:27.761962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:27.762845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:27.763578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:27.766648 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 54/110] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:27.770244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.770572 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.770849 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.792536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:27.793738 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:27.808176 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f49c39-9a7d-4777-a349-b3999be8afe3 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:27.817904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:27.846228 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:27.847282 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:27.847772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:27.848277 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:27.849676 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:27.851452 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:27.853569 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 57/111] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:27.859082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.862949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 55/112] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:27.866493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:27.926872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:27.965092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0ad0a-1c5b-4e45-bbfd-173d737fa391 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:27.989884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd05987-8d7e-4e67-a912-8a172e407b85 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.002884 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.003510 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.003785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.004051 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.004837 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:28.005144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.006830 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.016523 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 56/113] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.017398 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.028133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.028843 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.029127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.029404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.041903 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:28.047003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:28.047814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:28.048962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 58/114] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:28.050187 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.050326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.131308 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979626-6c1f-4930-a8b7-aa71e507fe19 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.143340 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.149888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739594c4-0db0-4bf9-a8af-52755df27326 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.168448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.169112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.169624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.169782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/38d5d95ae1f34880b821c1d52307fcc4/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.171669 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] RBAC: Authorizing `identity:create_grant(project_id=6db042a0872b4a3ea922675cac1ff64c, user_id=38d5d95ae1f34880b821c1d52307fcc4, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.173125 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.187223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.187914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.188192 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.188287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:28 2022] PUT /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/38d5d95ae1f34880b821c1d52307fcc4/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:28.188734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.189215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.210365 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:28.217771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:28.218723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:28.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 59/116] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:28.223188 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.290724 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.312723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835031b-738d-4dd0-9d82-81db1139f29d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.339168 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a4e40-95fc-4052-97bc-aa76e7de33d7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.350484 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5738c5f-024f-48bd-883b-b66b7889cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.351159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738c5f-024f-48bd-883b-b66b7889cbb4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.351445 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738c5f-024f-48bd-883b-b66b7889cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.351719 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5738c5f-024f-48bd-883b-b66b7889cbb4 None admin] PATH_INFO: `/v3/users/81a2cd1a051f4c9d8b17e265a9544980` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.370642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5738c5f-024f-48bd-883b-b66b7889cbb4 None admin] RBAC: Authorizing `identity:get_user(user_id=81a2cd1a051f4c9d8b17e265a9544980)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.372167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5738c5f-024f-48bd-883b-b66b7889cbb4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.373882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 58/117] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/users/81a2cd1a051f4c9d8b17e265a9544980 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.375072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cbf4-8184-461c-a638-e9686d715b7d None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.375351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cbf4-8184-461c-a638-e9686d715b7d None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.375628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cbf4-8184-461c-a638-e9686d715b7d None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.376968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 59/118] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:28.377672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2cbf4-8184-461c-a638-e9686d715b7d None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.378730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.379347 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.379621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.379889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.380754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:28.381120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.383533 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.393555 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 60/119] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.394371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.413214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.483928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2cbf4-8184-461c-a638-e9686d715b7d None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.498026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695c303-87d7-45f8-b402-427519128d4f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.521655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.522628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.523103 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.523583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.524471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:28.524983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.526644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22c0b9-87ae-4749-bd65-67952894185e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.532923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.533565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.533848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.534122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.535270 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.535659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 60/120] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.536969 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.537405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.537861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.539701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.541579 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 61/121] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.542369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.549385 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.561542 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:28.562786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:28.636300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.642784 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 61/122] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:28.644137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.655436 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395103c-d48f-4ced-9422-5b1444b4eff4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.692096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.692872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.693249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.693619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.767444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c93321-c581-4d3c-ab4d-26a07a5c2dc5 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.781864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.783537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.805596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.813668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.814775 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.815189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.815804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.817691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.819549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.822214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 62/123] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.823137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.884039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:28.918817 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 62/124] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:28.919869 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:28.946256 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c644b-61f6-4106-b3cc-634f9fe2b5af None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:28.981967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:28.982871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:28.983148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:28.983429 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:28.984563 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:28.986041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:28.987806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 63/125] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:28.988427 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.045889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7bde6-0e0c-496b-98a4-83861dea9a14 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.057318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.082174 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.082830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.083110 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.083382 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.084036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.085520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.093257 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580f0b-3dd1-421a-b400-d4b143321758 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.130477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 63/126] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:32:28 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:29.130477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.142313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.143376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.143480 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.143676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.144861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.146528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.148432 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:28 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:29.149053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.179333 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.257082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bdcc0-6206-4b32-852d-730708134603 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.278075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4a7f1-9a00-4c69-b3d7-dca2d58d5905 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.299982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.300656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.300939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.301216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.302566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.304118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.305970 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 64/128] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:29.306910 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.327751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.329188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.329671 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.330130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.334244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.346325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:29.352704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:29.353646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:29.354499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:29.361553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:29.361553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.430796 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f03e5-c3d1-44f2-9c94-755c14ec0c5c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.447018 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.484697 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.485443 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.485734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.486008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.487168 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.488261 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b47d4-931a-4e30-821d-af9f84485dce None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.488687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.490756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 65/130] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:29.491615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.523989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.524669 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.525342 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.525625 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/e41f3e4d789846bd8210f42df0a1bb8c/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.527977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db042a0872b4a3ea922675cac1ff64c, user_id=e41f3e4d789846bd8210f42df0a1bb8c, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.530079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:29 2022] PUT /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/e41f3e4d789846bd8210f42df0a1bb8c/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:29.550364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.619273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91acd987-e9ee-4832-8eca-f404f60abc69 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.635113 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.695116 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe8ac-f69e-40b0-96c9-b68d2d87dc54 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.704019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.704701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.704983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.705261 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.706343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] RBAC: Adding query filter params (role.id=71cf3b3bee4f4e2493f9c9deb997fde1, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=81a2cd1a051f4c9d8b17e265a9544980) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:29.706343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.707836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.723214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 66/132] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/role_assignments?user.id=81a2cd1a051f4c9d8b17e265a9544980&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=71cf3b3bee4f4e2493f9c9deb997fde1 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:29.724224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.748887 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.751182 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.751459 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.752221 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.753757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] RBAC: Adding query filter params (name=member) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:29.754055 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.755793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.775540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 67/133] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:29.782693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:29.793603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.910254 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a680-8c38-4ba9-b690-cfb2d00d9a9a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.933558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:29.959088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:29.960095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:29.961345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:29.961815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:29.964960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaa766-f19a-4c1b-b025-07e1c7e3d537 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:29.965860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:29.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:29.972181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 68/134] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:29.988242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:30.052251 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:30.053223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:30.053223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:30.053563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/e41f3e4d789846bd8210f42df0a1bb8c/roles/d8b807df19b642feae1864b059dea9cf` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:30.060299 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db042a0872b4a3ea922675cac1ff64c, user_id=e41f3e4d789846bd8210f42df0a1bb8c, role_id=d8b807df19b642feae1864b059dea9cf)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:30.061880 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:30.100974 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 67/135] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:29 2022] PUT /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/e41f3e4d789846bd8210f42df0a1bb8c/roles/d8b807df19b642feae1864b059dea9cf => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:30.112152 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b626-762b-4b42-8aaf-8b1a5f7726bf None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:30.161792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd2701-96b3-4e84-8923-249b22771488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:30.162825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd2701-96b3-4e84-8923-249b22771488 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:30.163297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd2701-96b3-4e84-8923-249b22771488 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:30.163777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd2701-96b3-4e84-8923-249b22771488 None admin] PATH_INFO: `/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:30.165137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd2701-96b3-4e84-8923-249b22771488 None admin] RBAC: Authorizing `identity:get_project(project_id=fb0d66b2868e4cc2834d428bf0e0f3df)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:30.166915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd2701-96b3-4e84-8923-249b22771488 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:30.168748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 69/136] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:29 2022] GET /identity/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:30.174848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:30.340737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:30.348453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976dd25-d98f-46cb-8cb9-3326ad459f96 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:30.385842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd723cba-b94c-45bc-b348-89bb75cf0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:30.386552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723cba-b94c-45bc-b348-89bb75cf0527 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:30.386831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723cba-b94c-45bc-b348-89bb75cf0527 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:30.387106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd723cba-b94c-45bc-b348-89bb75cf0527 None admin] PATH_INFO: `/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df/users/e41f3e4d789846bd8210f42df0a1bb8c/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:30.389070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723cba-b94c-45bc-b348-89bb75cf0527 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb0d66b2868e4cc2834d428bf0e0f3df, user_id=e41f3e4d789846bd8210f42df0a1bb8c, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:30.390615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd723cba-b94c-45bc-b348-89bb75cf0527 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:30.411291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 68/137] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:30 2022] PUT /identity/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df/users/e41f3e4d789846bd8210f42df0a1bb8c/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:30.840214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e33a9-ec7d-44ea-abbf-5a5565092160 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:30.841394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e33a9-ec7d-44ea-abbf-5a5565092160 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:30.841806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e33a9-ec7d-44ea-abbf-5a5565092160 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:30.843571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 70/138] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:30.856231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:30.857120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:30.857602 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:30.878514 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:30.880137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:30.965366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 69/139] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:31.590700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e33a9-ec7d-44ea-abbf-5a5565092160 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:31.662647 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:31.724236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e33a9-ec7d-44ea-abbf-5a5565092160 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:31.766257 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e48b-65e6-4aae-93a7-25e33b17d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:31.766933 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e48b-65e6-4aae-93a7-25e33b17d22b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:31.767210 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e48b-65e6-4aae-93a7-25e33b17d22b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:31.767480 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e48b-65e6-4aae-93a7-25e33b17d22b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:31.787606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9e48b-65e6-4aae-93a7-25e33b17d22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-f7c9e48b-65e6-4aae-93a7-25e33b17d22b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:31.793128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:31.793963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:31.794748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 71/140] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:31.801883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:31.930832 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:31.955307 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bf493-ed13-47c9-ad03-6179839243b3 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:31.994993 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749e19-a1cf-4cad-a46c-fe7703dd561c None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:31.995498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749e19-a1cf-4cad-a46c-fe7703dd561c None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:31.995599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749e19-a1cf-4cad-a46c-fe7703dd561c None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:31.996870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 72/141] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:32.002973 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:32.003255 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:32.003525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:32.015991 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:32.016614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:32.016888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:32.017153 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:32.017828 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:32.018126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:32.021220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:32.035720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:32.035720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:32.039154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 70/142] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:32.044931 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:32.160236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:32.190097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800acf-e7a5-45d3-ab7b-b7cdee521646 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:32.234732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:32.235423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:32.235702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:32.235975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] PATH_INFO: `/v3/users/38d5d95ae1f34880b821c1d52307fcc4` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:32.237111 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] RBAC: Authorizing `identity:get_user(user_id=38d5d95ae1f34880b821c1d52307fcc4)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:32.238595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:32.240483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 71/144] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:32 2022] GET /identity/v3/users/38d5d95ae1f34880b821c1d52307fcc4 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:32.245992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:32.314658 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:32.390101 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541890-e7a0-4a73-82ae-20769c943d84 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:32.432565 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:32.433092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:32.433366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:32.433631 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:32.500226 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:32.501970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:32.560363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:32.631817 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 74/145] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:32.637394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:32.656215 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:32.762859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaff3ed-8059-41e8-a50f-53a600dc6c8c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:32.782494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:32.818020 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:32.819025 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:32.819577 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:32.820022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:32.823438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:32.825101 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:32.827814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 72/146] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:32 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:32.833465 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:32.949053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:32.960101 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e30d-7256-4052-ae8b-bbdd2483060b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:32.982792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae45f3-4df9-48cf-bb4f-feb750275ee9 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:33.005711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:33.007091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.007559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.008032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.009603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:33.011577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:33.013746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 75/147] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:33.020180 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:33.037579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:33.083209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:33.083846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.084126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.084397 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.085148 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=38d5d95ae1f34880b821c1d52307fcc4) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:33.085454 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:33.086950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3182a-c6b6-44a3-b9d9-930c5670dcb8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:33.096379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 73/148] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:32 2022] GET /identity/v3/role_assignments?user.id=38d5d95ae1f34880b821c1d52307fcc4&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=0f13813da5a84a44829df58f1d837465 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:33.180531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa173d-427c-45ae-834d-9afae694b96a None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.180531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa173d-427c-45ae-834d-9afae694b96a None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.180531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa173d-427c-45ae-834d-9afae694b96a None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.181193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 74/149] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:33.186742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494aaba-be77-450b-a358-159668a80c08 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494aaba-be77-450b-a358-159668a80c08 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.187666 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494aaba-be77-450b-a358-159668a80c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.222484 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce337d-f3b4-4106-88c5-ee1ecabea47b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:33.243682 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e494aaba-be77-450b-a358-159668a80c08 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:33.245203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e494aaba-be77-450b-a358-159668a80c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:33.309121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3341-9846-4344-a11b-250d8f771089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:33.309799 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3341-9846-4344-a11b-250d8f771089 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.310143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3341-9846-4344-a11b-250d8f771089 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.310735 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3341-9846-4344-a11b-250d8f771089 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.311328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd3341-9846-4344-a11b-250d8f771089 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:33.312873 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd3341-9846-4344-a11b-250d8f771089 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:33.383777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 76/150] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:33 2022] POST /identity/v3/users => generated 283 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:33.383777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aadc6f-1e8e-4fba-8f93-beacae4f7176 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.383777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aadc6f-1e8e-4fba-8f93-beacae4f7176 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.383777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aadc6f-1e8e-4fba-8f93-beacae4f7176 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.388122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 75/151] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:33.390885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 77/152] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:33.396766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727af87-0a96-46da-9a0b-8f82337223d1 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.397390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727af87-0a96-46da-9a0b-8f82337223d1 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.397886 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727af87-0a96-46da-9a0b-8f82337223d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.435775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-0727af87-0a96-46da-9a0b-8f82337223d1 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:33.437344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-0727af87-0a96-46da-9a0b-8f82337223d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:33.541117 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 76/153] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:33.631612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863186-56e2-40d3-aa21-8499a062f049 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.631846 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863186-56e2-40d3-aa21-8499a062f049 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.632063 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863186-56e2-40d3-aa21-8499a062f049 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.633561 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 78/154] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:33.639724 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:33.640304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:33.640767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:33.663248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:33.664807 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:33.667371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:33.755786 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 77/155] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:33.890946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863186-56e2-40d3-aa21-8499a062f049 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:33.972307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:33.984794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.021230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863186-56e2-40d3-aa21-8499a062f049 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.069839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d06a-d2d6-4d69-96e9-a46c92b2d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.070490 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d06a-d2d6-4d69-96e9-a46c92b2d231 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.070935 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d06a-d2d6-4d69-96e9-a46c92b2d231 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.071346 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d06a-d2d6-4d69-96e9-a46c92b2d231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.082498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d06a-d2d6-4d69-96e9-a46c92b2d231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-0f55d06a-d2d6-4d69-96e9-a46c92b2d231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:34.087679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:34.088539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:34.089307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:34.092372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 79/156] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:34.094329 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1aa6-8c5a-40c4-9d2a-773f5f5cc5f1 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.094814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1aa6-8c5a-40c4-9d2a-773f5f5cc5f1 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.095257 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1aa6-8c5a-40c4-9d2a-773f5f5cc5f1 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.098121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 80/157] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:34.099097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1aa6-8c5a-40c4-9d2a-773f5f5cc5f1 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.112595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bb6bb-01da-4128-9462-2a3abd0c5647 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.159903 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df9c9e-1d7a-4003-a8ac-7b9ad8d90d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.161004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df9c9e-1d7a-4003-a8ac-7b9ad8d90d43 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.161480 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df9c9e-1d7a-4003-a8ac-7b9ad8d90d43 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.161758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df9c9e-1d7a-4003-a8ac-7b9ad8d90d43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.169815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:34.175378 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df9c9e-1d7a-4003-a8ac-7b9ad8d90d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-72df9c9e-1d7a-4003-a8ac-7b9ad8d90d43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:34.182170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:34.183451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:34.184479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:34.187084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 78/158] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:34.189330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.189766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.190383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.218996 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:34.220832 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:34.228254 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1aa6-8c5a-40c4-9d2a-773f5f5cc5f1 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.265273 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:34.273772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.275201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.275546 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.275882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.276641 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] RBAC: Adding query filter params (name=member) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:34.277010 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:34.279397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:34.292214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 81/159] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:34.293124 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.311839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 79/160] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:34.312791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.421767 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb575452-512f-4fc8-9ddb-d4eb0cfa6a01 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.429429 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226556c-3a88-4074-aff1-511a5d925e53 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.472242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:34.480148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.480789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.481059 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.481327 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.488837 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.489445 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.489717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.489977 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.490671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:34.490965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:34.492361 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:34.505009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:34.510421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:34.511297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:34.512110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:34.515161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 80/161] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:34.515161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.515672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 82/162] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:34.523475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.575585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:34.626284 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e2ee5-ff5e-43c0-99a4-aa8abf0a647f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.660988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.661622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.661897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.662169 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] PATH_INFO: `/v3/users/81a2cd1a051f4c9d8b17e265a9544980` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.663339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] RBAC: Authorizing `identity:get_user(user_id=81a2cd1a051f4c9d8b17e265a9544980)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:34.664812 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:34.666794 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 83/163] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/users/81a2cd1a051f4c9d8b17e265a9544980 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:34.667569 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.721156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e174a4d-c8c2-4bba-8ab7-8fe05091f934 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.773424 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f229e1d-9272-4b35-bc84-c4100a25516b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.786207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.786994 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.787366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.787936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.791203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:34.792567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:34.793973 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:34.796230 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 81/164] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:34.797201 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.811103 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.811719 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.812131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.812404 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.813089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:34.813403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:34.814835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:34.823732 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 84/165] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:34.824814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:34.926662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4db07-ed2c-42d6-90f1-8181a0c95fb5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:34.960597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:34.961545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:34.962013 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:34.962528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:34.966188 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:34.974000 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:34.980578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:34.981454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:34.982252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:34.984585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 85/166] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:34.985543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:35.043443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:35.061316 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f404-346a-4765-b86d-084485762490 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:35.127447 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:35.128731 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:35.129317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:35.129759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:35.131081 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:35.133145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:35.135318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 82/167] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:35.136572 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:35.148705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06952a0b-8aa1-43c1-9734-e86c664486a9 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:35.190386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:35.191085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:35.191370 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:35.191642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:35.310518 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437cbaf-9a1b-4065-a558-14fa1ccf0bb0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:35.332417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:35.333921 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:35.365702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:35.384418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:35.385065 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:35.385344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:35.385612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:35.387901 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:35.390106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:35.392589 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 83/168] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:35 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:35.393405 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:35.410804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:35.512600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 86/169] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:35.513455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:35.554801 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d3a60-7c56-46f4-8fc0-1c5aa2d38e5c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:35.612753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:35.613281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:35.613548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:35.613812 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:35.614485 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:35.614783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:35.616332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:35.634476 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:35.634476 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:35.706366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:35.757136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac6a5e-e9e3-4fd8-bd5f-1cd1343405a0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:35.780544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3490b2-5977-44de-92e1-f5be87ee9f47 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:35.797978 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:35.799020 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:35.799509 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:35.799985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:35.882032 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:35.884002 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:35.935171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:35.935837 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:35.936109 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:35.936374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/81a2cd1a051f4c9d8b17e265a9544980/roles/71cf3b3bee4f4e2493f9c9deb997fde1` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:35.943617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] RBAC: Authorizing `identity:create_grant(project_id=6db042a0872b4a3ea922675cac1ff64c, user_id=81a2cd1a051f4c9d8b17e265a9544980, role_id=71cf3b3bee4f4e2493f9c9deb997fde1)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:35.945179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:35.962051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:35.979680 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:35.997029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 87/171] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:35 2022] PUT /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c/users/81a2cd1a051f4c9d8b17e265a9544980/roles/71cf3b3bee4f4e2493f9c9deb997fde1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:35.997983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.006079 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 85/172] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:36.012680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.196830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15decd83-69a9-42e5-9ba9-80d91a86a743 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:36.255787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c07e2-f2d8-4321-a8ce-0f474d788afc None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:36.265830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:36.266882 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.267941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.268496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] PATH_INFO: `/v3/users/e41f3e4d789846bd8210f42df0a1bb8c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.269841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] RBAC: Authorizing `identity:get_user(user_id=e41f3e4d789846bd8210f42df0a1bb8c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:36.271527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:36.277450 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 86/173] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:36 2022] GET /identity/v3/users/e41f3e4d789846bd8210f42df0a1bb8c => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:36.277450 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.337066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:36.359970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:36.360623 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.360889 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.361157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.362403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:36.363875 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:36.368813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 88/174] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:35 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:36.369624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.502949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:36.518859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41157-fc6d-4b0f-885a-d4a8afc04d73 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:36.540701 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d207f-31c8-47e9-87a3-0565fdc5656a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:36.566111 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:36.566784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.567042 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.567305 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.568430 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:36.569882 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:36.571613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 87/175] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:36 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:36.572376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.580615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1cb6-60de-4c14-9102-274dd1cba44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:36.581352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1cb6-60de-4c14-9102-274dd1cba44b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.581632 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1cb6-60de-4c14-9102-274dd1cba44b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.581936 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1cb6-60de-4c14-9102-274dd1cba44b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.656992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb1cb6-60de-4c14-9102-274dd1cba44b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:36.658511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb1cb6-60de-4c14-9102-274dd1cba44b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:36.727122 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:36.744738 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:36.754655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31442a-2d95-4505-8b70-76a4b8502e20 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:36.766688 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 89/176] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:36.768155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ca114-72b3-442b-889b-95156aa6f43a None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.768443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ca114-72b3-442b-889b-95156aa6f43a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.768785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ca114-72b3-442b-889b-95156aa6f43a None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.770201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 90/177] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:36.775259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ca114-72b3-442b-889b-95156aa6f43a None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.793258 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:36.794312 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.794818 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.795423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.796386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=e41f3e4d789846bd8210f42df0a1bb8c) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:36.796881 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:36.798683 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:36.805188 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 88/178] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:36 2022] GET /identity/v3/role_assignments?user.id=e41f3e4d789846bd8210f42df0a1bb8c&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=ea04e85c0aa7408095b855be56c86503 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:36.806303 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:36.919715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba4d9a-71f1-4fd1-a8b0-44b1773d5d75 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:36.957631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb71d1-0299-4c11-88b9-58d36ccdbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:36.958458 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb71d1-0299-4c11-88b9-58d36ccdbf63 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.958844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb71d1-0299-4c11-88b9-58d36ccdbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.959235 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb71d1-0299-4c11-88b9-58d36ccdbf63 None admin] PATH_INFO: `/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.960670 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb71d1-0299-4c11-88b9-58d36ccdbf63 None admin] RBAC: Authorizing `identity:get_project(project_id=fb0d66b2868e4cc2834d428bf0e0f3df)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:36.962298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb71d1-0299-4c11-88b9-58d36ccdbf63 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:36.964518 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 89/179] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:36 2022] GET /identity/v3/projects/fb0d66b2868e4cc2834d428bf0e0f3df => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:36.966228 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb08644-2f5f-4d43-b367-4b0b9745bbdc None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:36.966644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb08644-2f5f-4d43-b367-4b0b9745bbdc None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:36.967081 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb08644-2f5f-4d43-b367-4b0b9745bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:36.987265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2bb08644-2f5f-4d43-b367-4b0b9745bbdc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:36.988762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2bb08644-2f5f-4d43-b367-4b0b9745bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:37.009603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:37.068089 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:37.069691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ca114-72b3-442b-889b-95156aa6f43a None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:37.069835 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5781a-5507-44c3-b294-b934101358d5 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.070171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5781a-5507-44c3-b294-b934101358d5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.070565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5781a-5507-44c3-b294-b934101358d5 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.072443 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 91/181] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:37.073274 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5781a-5507-44c3-b294-b934101358d5 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:37.108253 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:37.109247 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.109722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.110182 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.111133 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] RBAC: Adding query filter params (role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=e41f3e4d789846bd8210f42df0a1bb8c) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:37.111628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:37.113359 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1683d-1eb4-49c6-ad9d-50326d390f15 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:37.120239 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 91/182] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:36 2022] GET /identity/v3/role_assignments?user.id=e41f3e4d789846bd8210f42df0a1bb8c&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=d8b807df19b642feae1864b059dea9cf => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:37.121801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51decd-48ba-40e8-9997-785683bfe751 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.122275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51decd-48ba-40e8-9997-785683bfe751 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.122793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51decd-48ba-40e8-9997-785683bfe751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.152562 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-0b51decd-48ba-40e8-9997-785683bfe751 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:37.154135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-0b51decd-48ba-40e8-9997-785683bfe751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:37.190494 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5781a-5507-44c3-b294-b934101358d5 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:37.222861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:37.281931 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:37.282633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.282819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.283087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.285297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=fb0d66b2868e4cc2834d428bf0e0f3df, user.id=e41f3e4d789846bd8210f42df0a1bb8c) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:37.285608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:37.290271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930a24e-5f37-40ff-9ead-f0445f34018f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:37.304381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 92/183] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:37 2022] GET /identity/v3/role_assignments?user.id=e41f3e4d789846bd8210f42df0a1bb8c&scope.project.id=fb0d66b2868e4cc2834d428bf0e0f3df&role.id=ea04e85c0aa7408095b855be56c86503 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:37.311567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 92/184] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:37.316284 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee052bf-a979-42c5-8d68-84145329ee2d None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.316576 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee052bf-a979-42c5-8d68-84145329ee2d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.316839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee052bf-a979-42c5-8d68-84145329ee2d None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.318296 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 93/185] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:37.324258 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.324553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.324879 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.346168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:37.351398 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:37.428102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 93/186] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:37.678127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee052bf-a979-42c5-8d68-84145329ee2d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:37.701997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:37.724580 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:37.820300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee052bf-a979-42c5-8d68-84145329ee2d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:37.857924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:37.876697 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:37.877143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e99f4d-3bc7-41b7-bdb0-d24c8b4c97a0 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:37.877335 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.877606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.877872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.894595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:37.897732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:37.898649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:37.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 94/187] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:37.900218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:37.924119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:37.924756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:37.925030 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:37.925297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:37.940073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:37.946612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:37.947485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:37.948277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 94/188] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:32:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:32:37.949528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:37.997640 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.026825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f0f6b-6128-4bc1-a88a-99d53f3bf8a8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.052527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f441be2-2f7c-4ae8-ac6b-dd2db21ef2a5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.065377 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.066010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.066289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.066598 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.067707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.069166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.070781 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 95/189] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:38.071570 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.087812 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.088408 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.088686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.088957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.089655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:38.089945 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.091639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.099884 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 95/190] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:38.100686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.118759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.182088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604877b-18f4-4ce4-bca0-1ecaeb427bee None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.206748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155caee4-6cff-4876-8155-3b704dfaaa2a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.217266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.218046 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.218512 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.218914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.219706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:38.220137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.221663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.230497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 96/191] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:38.236173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.242197 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.242843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.243114 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.243452 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.244128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.245565 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.247799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.268244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 96/192] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:38 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:38.268996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.359749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a847d-bbaa-4921-8982-bd26568270c4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.381190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.403381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.404105 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.404383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.404647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] PATH_INFO: `/v3/users/07095b000ad24c1da2f8d3f319c81063` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.421178 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] RBAC: Authorizing `identity:get_user(user_id=07095b000ad24c1da2f8d3f319c81063)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.422763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.424656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 97/193] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/users/07095b000ad24c1da2f8d3f319c81063 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:38.426903 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f7e77-ca8a-4366-842d-cae6256166a7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.430698 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.473418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.474287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.474739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.475155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] PATH_INFO: `/v3/users/07095b000ad24c1da2f8d3f319c81063` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.476511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] RBAC: Authorizing `identity:get_user(user_id=07095b000ad24c1da2f8d3f319c81063)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.478741 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.481001 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 97/194] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/users/07095b000ad24c1da2f8d3f319c81063 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:38.487338 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.513673 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.561975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ebb3-d2a3-415f-8fd2-6c577809b65a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.603356 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.604156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.604610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.604948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.615863 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d776b03-abed-4f2d-94b6-124b28e477fb None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.653004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:38.653618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:38.653890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:38.654158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:38.663871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.684863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.686343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.738071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:38.739512 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:38.778835 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.833544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 98/195] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:32:38.841653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.861608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 98/196] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:38.867970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:38.922891 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:38.973752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd37f-e638-4b0c-ab80-4ad9bffc87c4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:38.980534 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f044-6fb0-470f-b810-035f4a276ee4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:39.032519 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563b7c-f0ee-42dc-84ab-36e08594d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:39.033075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563b7c-f0ee-42dc-84ab-36e08594d286 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.033346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563b7c-f0ee-42dc-84ab-36e08594d286 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.033610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563b7c-f0ee-42dc-84ab-36e08594d286 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.035324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:39.035956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.036235 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.037007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563b7c-f0ee-42dc-84ab-36e08594d286 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:39.038504 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563b7c-f0ee-42dc-84ab-36e08594d286 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:39.038857 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.040371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 99/197] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:39.040758 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:39.042406 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:39.044289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 99/198] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:38 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:39.045594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171d2aa-b8df-46e4-a225-7d384998e527 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.045872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171d2aa-b8df-46e4-a225-7d384998e527 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.046200 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171d2aa-b8df-46e4-a225-7d384998e527 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.048409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:39.048777 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 100/199] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:39.054042 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.054317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.054608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.073080 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:39.074266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:39.103719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:39.150299 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 101/200] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:39.151502 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:39.168221 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019303e9-a0dc-4df3-85c2-f78f79cfdf90 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:39.176726 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:39.226295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:39.227141 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.227415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.227714 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.228463 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=07095b000ad24c1da2f8d3f319c81063) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:39.228758 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:39.230194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:39.242840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 100/201] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:39 2022] GET /identity/v3/role_assignments?user.id=07095b000ad24c1da2f8d3f319c81063&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=0f13813da5a84a44829df58f1d837465 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:39.301201 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3aa5f7-cf83-4e78-b211-fe52020ed6bd None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:39.338156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:39.338798 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.339066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.339329 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.340063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] RBAC: Adding query filter params (role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=07095b000ad24c1da2f8d3f319c81063) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:39.340371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:39.342133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:39.354615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 102/202] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:39 2022] GET /identity/v3/role_assignments?user.id=07095b000ad24c1da2f8d3f319c81063&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=d8b807df19b642feae1864b059dea9cf => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:39.498772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:39.605862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e10eb-9f89-44b4-a545-cb14e78ebcd6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:39.649595 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:39.650732 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.651229 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.651717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.671278 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:39.676697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:39.677576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:39.678362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 101/203] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:39.685650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:39.737161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:39.838500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85665-ddd1-4264-91c3-0ec5ed1e04e4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:39.889206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:39.889747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:39.894475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:39.894475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:39.894475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:39.894475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:39.894475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:39.907910 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 103/204] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:39.913698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:39.989657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:40.086903 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09a96-b014-4987-b7e4-7c2253dc5ab7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:40.139346 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:40.139901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:40.140175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:40.140443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] PATH_INFO: `/v3/users/81a2cd1a051f4c9d8b17e265a9544980` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:40.147110 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] RBAC: Authorizing `identity:get_user(user_id=81a2cd1a051f4c9d8b17e265a9544980)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:40.148578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:40.150512 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 102/205] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:39 2022] GET /identity/v3/users/81a2cd1a051f4c9d8b17e265a9544980 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:40.155961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:40.291622 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:40.303076 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae6ee6-57bf-4067-9850-273f7d04a597 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:40.346926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:40.347638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:40.347917 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:40.348185 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:40.432803 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:40.434225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:40.526547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:40.536826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 104/206] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:40.542551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:40.751421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:40.758262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260df816-b283-4506-9f53-1ac25aea8a3a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:40.835190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c8f33-fdaf-483d-ae72-fd17acc65996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:40.835851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8f33-fdaf-483d-ae72-fd17acc65996 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:40.836128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8f33-fdaf-483d-ae72-fd17acc65996 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:40.836407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c8f33-fdaf-483d-ae72-fd17acc65996 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:40.843503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c8f33-fdaf-483d-ae72-fd17acc65996 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:40.845006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c8f33-fdaf-483d-ae72-fd17acc65996 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:40.847185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 103/207] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:40 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:40.853390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:41.004718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2bb51-2fdd-4e93-afe1-ec83d9f50d8f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:41.039009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:41.039668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.039940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.040257 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.040979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] RBAC: Adding query filter params (role.id=71cf3b3bee4f4e2493f9c9deb997fde1, scope.project.id=6db042a0872b4a3ea922675cac1ff64c, user.id=81a2cd1a051f4c9d8b17e265a9544980) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:41.041278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:41.042751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889afc5-54b9-4d44-9e30-45d638e2539b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:41.049057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 105/208] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:40 2022] GET /identity/v3/role_assignments?user.id=81a2cd1a051f4c9d8b17e265a9544980&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=71cf3b3bee4f4e2493f9c9deb997fde1 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:41.253437 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eafe5-446f-4fd5-a45e-5dc51ae8ec11 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.253808 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eafe5-446f-4fd5-a45e-5dc51ae8ec11 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.254004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264eafe5-446f-4fd5-a45e-5dc51ae8ec11 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.255661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 104/209] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:41.273895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85a0d-6e6f-4bdd-8aee-bebec9ae3dc7 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.274628 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85a0d-6e6f-4bdd-8aee-bebec9ae3dc7 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.275103 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d85a0d-6e6f-4bdd-8aee-bebec9ae3dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.299795 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-36d85a0d-6e6f-4bdd-8aee-bebec9ae3dc7 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:41.301339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-36d85a0d-6e6f-4bdd-8aee-bebec9ae3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:41.358417 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:41.377451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 106/210] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:41.606124 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b04a7-9d2f-431c-880f-e648651e467b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.607113 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b04a7-9d2f-431c-880f-e648651e467b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.607682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b04a7-9d2f-431c-880f-e648651e467b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.609460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 105/211] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:41.615236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.615796 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.616262 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.637467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:41.639022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:41.719452 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 107/212] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:41.728944 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b04a7-9d2f-431c-880f-e648651e467b None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:41.836793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b04a7-9d2f-431c-880f-e648651e467b None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:41.871356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8110-9c54-4371-abe1-a680c169300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:41.872288 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8110-9c54-4371-abe1-a680c169300b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.872739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8110-9c54-4371-abe1-a680c169300b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.873194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8110-9c54-4371-abe1-a680c169300b None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.886142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f8110-9c54-4371-abe1-a680c169300b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-632f8110-9c54-4371-abe1-a680c169300b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:41.891952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:41.892856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:41.893627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:41.895958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 106/213] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:41.906523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:41.919464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dfdd5-d3cf-4b98-9e0e-e251eacacb8a None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.919744 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dfdd5-d3cf-4b98-9e0e-e251eacacb8a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.920019 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dfdd5-d3cf-4b98-9e0e-e251eacacb8a None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.921626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 107/214] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:41.927081 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:41.927358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:41.927636 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:41.945830 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:41.947095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:41.970683 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.013627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e1a98-ddcf-41d2-8b01-b69cf9d9eb1a None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.026643 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 108/215] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:42.034860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.051147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.051782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.052059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.052324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.053007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:42.053308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:42.055008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.055307 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe743b37-5e12-4fc2-a591-6a592aba8980 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:42.065751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 108/216] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:42.071697 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5e949-51a1-4c3b-b54c-3e5d70e27910 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.071983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5e949-51a1-4c3b-b54c-3e5d70e27910 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.072275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5e949-51a1-4c3b-b54c-3e5d70e27910 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.073703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 109/217] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:42.074249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5e949-51a1-4c3b-b54c-3e5d70e27910 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.164180 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78874389-86b7-40b6-a8c5-0d65c66cb4fc None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.180228 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5e949-51a1-4c3b-b54c-3e5d70e27910 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.200634 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3965-0832-47ff-ab9d-3c4ef03fac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.201625 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3965-0832-47ff-ab9d-3c4ef03fac51 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.201908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3965-0832-47ff-ab9d-3c4ef03fac51 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.202425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3965-0832-47ff-ab9d-3c4ef03fac51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.204014 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3965-0832-47ff-ab9d-3c4ef03fac51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:42.205891 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3965-0832-47ff-ab9d-3c4ef03fac51 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:42.208599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 109/218] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:42.210655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.211064 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.211410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.218073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.219027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.219517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.219955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] PATH_INFO: `/v3/users/a2e52d201b7d46fc8249f814b80746d6` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.231374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:42.232557 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:42.234711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] RBAC: Authorizing `identity:get_user(user_id=a2e52d201b7d46fc8249f814b80746d6)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:42.236390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:42.238197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 110/219] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/users/a2e52d201b7d46fc8249f814b80746d6 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:42.239114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.254367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.277629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.322680 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 110/220] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:42.327747 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.348202 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e3dd0-8849-4a38-aed0-a5cbaee7b682 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.382636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.383341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.383618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.383932 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.384582 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:42.386029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:42.410346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 111/221] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:42 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:42.415610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.452282 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680529ea-b625-4d63-a404-f8799854f8f4 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.507564 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.508191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.508460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.508760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.534900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.546392 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eedabc-86c6-4207-81d3-7ec59341c780 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.551091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.594850 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.595948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.596425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.596894 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.606420 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:42.607952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:42.609643 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:42.615692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:42.616545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:42.617328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:42.620015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 112/222] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:42.625932 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.730751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 111/223] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:42.733010 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.756843 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159663-6302-47a9-a2c8-aa075f145460 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.797279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.800979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.801871 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.802159 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.802517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.803369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:42.803978 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:42.805692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:42.817297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 113/224] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:42.818162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.843216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:42.850519 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882057cf-f8cf-4023-815f-a368656a5cdd None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.892687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.893384 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.893749 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.894023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:42.912762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:42.918992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:42.919915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:42.921024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 112/225] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:42.926416 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:42.956424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbc472-9476-4076-b85c-705e805e3bbf None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:42.998200 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:42.998768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:42.999040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:42.999308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.000424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.001882 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.003662 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 114/226] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:43.004544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.043610 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc2de8-ce0c-4526-bd71-5e5b5796e566 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.058690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:43.081220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.082134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.082583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.082990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] PATH_INFO: `/v3/users/07095b000ad24c1da2f8d3f319c81063` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.084329 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] RBAC: Authorizing `identity:get_user(user_id=07095b000ad24c1da2f8d3f319c81063)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.086017 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.087855 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 113/227] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:42 2022] GET /identity/v3/users/07095b000ad24c1da2f8d3f319c81063 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:43.088778 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.096491 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:43.118304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcff3-f4f3-4066-bc4a-e671ea9862e6 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.162694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.163310 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.163585 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.163849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.164591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:43.164890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.166343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.177244 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 115/228] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:43.178877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.194208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b9d3-fc2b-45aa-a346-3244c519a264 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.229346 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.230043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.230389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.230752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.231558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=a2e52d201b7d46fc8249f814b80746d6) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:43.231934 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.233381 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.239079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 114/229] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:43 2022] GET /identity/v3/role_assignments?user.id=a2e52d201b7d46fc8249f814b80746d6&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=ea04e85c0aa7408095b855be56c86503 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:43.239863 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.317677 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:43.340514 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219bfbc-dd39-4cd4-ba24-e4982911fbb5 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.402207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.406229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.406229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.406229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.406229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.406561 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.407701 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055f1f4-6ed6-417c-9815-0c8e894eb9e7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.409779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 116/230] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:43 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:43.438567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.452341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.453374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.453839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.454296 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] PATH_INFO: `/v3/users/07095b000ad24c1da2f8d3f319c81063` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.456611 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] RBAC: Authorizing `identity:get_user(user_id=07095b000ad24c1da2f8d3f319c81063)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.459102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.460550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:43.461901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 115/231] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:43 2022] GET /identity/v3/users/07095b000ad24c1da2f8d3f319c81063 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:43.469037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.573072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d157d-4eeb-4037-b1da-45511b0c1790 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.586207 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ce763-6114-4784-bf78-e939e9fd088f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.601713 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:43.608206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adb28c-681d-461b-9b8e-2a7282af7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.608874 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb28c-681d-461b-9b8e-2a7282af7637 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.609146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb28c-681d-461b-9b8e-2a7282af7637 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.609424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb28c-681d-461b-9b8e-2a7282af7637 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e/users/07095b000ad24c1da2f8d3f319c81063/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.612032 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb28c-681d-461b-9b8e-2a7282af7637 None admin] RBAC: Authorizing `identity:create_grant(project_id=436ab180354048eea2ec3859c35fb16e, user_id=07095b000ad24c1da2f8d3f319c81063, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.613830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb28c-681d-461b-9b8e-2a7282af7637 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.625661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.627060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.627626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.628097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.629518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.631633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.633913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 116/232] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:43 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:43.639478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 117/233] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:43 2022] PUT /identity/v3/projects/436ab180354048eea2ec3859c35fb16e/users/07095b000ad24c1da2f8d3f319c81063/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:43.640558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:43.776568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff254f64-6dfe-4499-ac8c-d9bf62b3d60a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:43.815941 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71597942-724d-4511-98cb-a3d9d7d5cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:43.817029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597942-724d-4511-98cb-a3d9d7d5cdc8 None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:43.817546 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597942-724d-4511-98cb-a3d9d7d5cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:43.818056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71597942-724d-4511-98cb-a3d9d7d5cdc8 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e/users/07095b000ad24c1da2f8d3f319c81063/roles/d8b807df19b642feae1864b059dea9cf` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:43.820577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71597942-724d-4511-98cb-a3d9d7d5cdc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=436ab180354048eea2ec3859c35fb16e, user_id=07095b000ad24c1da2f8d3f319c81063, role_id=d8b807df19b642feae1864b059dea9cf)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:43.822301 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71597942-724d-4511-98cb-a3d9d7d5cdc8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:43.837804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:43 2022] PUT /identity/v3/projects/436ab180354048eea2ec3859c35fb16e/users/07095b000ad24c1da2f8d3f319c81063/roles/d8b807df19b642feae1864b059dea9cf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:45.128767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c67d-b982-4f8f-b048-3e424fa18ac7 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:45.129281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c67d-b982-4f8f-b048-3e424fa18ac7 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:45.129281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c67d-b982-4f8f-b048-3e424fa18ac7 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:45.130848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 118/235] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:45.135888 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:45.136281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:45.136462 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:45.157999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:45.159258 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:45.207532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:45.216936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0dcef-2916-4677-b701-313748ee5e5b None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:45.217213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0dcef-2916-4677-b701-313748ee5e5b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:45.217486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0dcef-2916-4677-b701-313748ee5e5b None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:45.218860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 119/236] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:45.228796 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:45.229388 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:45.229905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:45.248916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:45.250428 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:45.253151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 118/237] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:45.314472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:45.319613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:45.689851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:45.831710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:45.844768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf75b-747f-414f-9913-beb6863965a2 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:45.899399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:45.900235 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:45.900654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:45.901061 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:45.912103 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:45.917318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:45.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:45.919409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:45.921627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 119/239] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:45.926996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:45.989529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:46.025343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670b6c5-9ba4-4282-9cb6-d9ec15b088a9 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.063756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e369f0-ad66-4585-8e7e-78c732df1b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:46.064631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e369f0-ad66-4585-8e7e-78c732df1b93 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.065138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e369f0-ad66-4585-8e7e-78c732df1b93 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.065541 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e369f0-ad66-4585-8e7e-78c732df1b93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.066934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e369f0-ad66-4585-8e7e-78c732df1b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:46.068797 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e369f0-ad66-4585-8e7e-78c732df1b93 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:46.070580 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 121/240] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:46.072209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dbb0b-6029-476d-87c5-a4b535032ef1 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.072706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dbb0b-6029-476d-87c5-a4b535032ef1 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.073183 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dbb0b-6029-476d-87c5-a4b535032ef1 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.074923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 122/241] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:46.075027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af764eb-e071-41da-9017-4a5af12f2197 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.084371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.084371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.084371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.100825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:46.102348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:46.110822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:46.111433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.111715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.111986 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.112659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] RBAC: Adding query filter params (name=reader) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:46.112963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:46.114378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:46.123328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 120/242] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:46.124220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:46.178028 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:46.194473 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 123/243] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:46.194473 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:46.257804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:46.271440 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7889c-7d7b-4229-a57b-fecd5417575b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.327435 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc0993-f993-420e-ab18-14b8e7ba079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:46.328044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0993-f993-420e-ab18-14b8e7ba079f None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.328319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0993-f993-420e-ab18-14b8e7ba079f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.328585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc0993-f993-420e-ab18-14b8e7ba079f None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.329248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0993-f993-420e-ab18-14b8e7ba079f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:46.330729 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc0993-f993-420e-ab18-14b8e7ba079f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:46.354936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6475e-0ccd-49a6-add9-07ba186713ae None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.356028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 121/244] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:46 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:46.358433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711dbb7-478e-4db1-b5ce-924978622a20 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.358774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711dbb7-478e-4db1-b5ce-924978622a20 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.359192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711dbb7-478e-4db1-b5ce-924978622a20 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.360885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 122/245] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:46.367961 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda64b6-9ae5-444e-9c24-609c38e01ae2 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.368287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda64b6-9ae5-444e-9c24-609c38e01ae2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.368597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda64b6-9ae5-444e-9c24-609c38e01ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.394797 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-9bda64b6-9ae5-444e-9c24-609c38e01ae2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:46.396583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9bda64b6-9ae5-444e-9c24-609c38e01ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:46.405862 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:46.406744 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.407090 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.407457 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] PATH_INFO: `/v3/users/a49d7bf5c2a7464787b6135056884e2e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.428312 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] RBAC: Authorizing `identity:get_user(user_id=a49d7bf5c2a7464787b6135056884e2e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:46.430612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:46.433242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 124/246] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:46 2022] GET /identity/v3/users/a49d7bf5c2a7464787b6135056884e2e => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:46.438916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:46.491632 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 123/247] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:46.503814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:46.551158 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453f03-9e83-4e24-b336-4b9ec03af5fe None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.562666 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370431-eb6b-4231-be94-f03e3774dd6b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.562965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370431-eb6b-4231-be94-f03e3774dd6b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.563231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370431-eb6b-4231-be94-f03e3774dd6b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.564796 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 124/248] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:46.569606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.569879 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.570153 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.588475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:46.588925 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:46.589094 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.589362 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.589631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.590171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:46.695006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 125/249] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:46.696264 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:46.703339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:46.705241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:46.709485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:46.776254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:46.829285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3f2e-1dc6-4049-8898-c525612c7318 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.831220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 125/250] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:32:46.837625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:46.876337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:46.877344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:46.877835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:46.878304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:46.891612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:46.896672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:46.897566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:46.898351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:46.903757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 126/251] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:46.904669 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:46.968398 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33af3-63d2-4258-a150-7d7db26c3a61 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:46.998324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.017793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.018433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.018733 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.019000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.020230 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.021639 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.023458 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 126/252] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:46 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.024042 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.043091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7ede6-3bf0-4e29-8229-ed8f50b2f842 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.058902 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.088554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.089124 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.089471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.089746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.102990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:47.107932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:47.108805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:47.109581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 127/253] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:47.110218 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.152120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc670ba-5322-43b4-8d7c-14884e2822a7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.186831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.188166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.188606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.189037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.189864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:47.190350 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.191918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.200885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 127/254] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.201932 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.221855 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419adf9-8c9b-4cac-8967-5f8914917f78 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.258222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.258950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.259168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.259443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.260352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] RBAC: Adding query filter params (role.id=71cf3b3bee4f4e2493f9c9deb997fde1, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=a49d7bf5c2a7464787b6135056884e2e) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:47.260670 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.262332 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.266862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.268855 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/role_assignments?user.id=a49d7bf5c2a7464787b6135056884e2e&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=71cf3b3bee4f4e2493f9c9deb997fde1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.274980 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.301486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.311782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca728ce-dfbf-4f25-b3aa-40b1fdfb7ce9 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.348798 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.349515 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.349882 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.350242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.366469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:47.367940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:47.368990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:32:47.370010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:47.371709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:47.372544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.498047 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a209-397b-4e66-b8c8-cfa58a0d0f4b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.523245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8b3f7-9e61-451e-a10e-fd033ee77900 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.549054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.549701 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.549974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.550250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.550958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:47.551256 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.552812 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.561861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 129/257] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.566858 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.575660 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.576298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.576570 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.576834 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] PATH_INFO: `/v3/users/a2e52d201b7d46fc8249f814b80746d6` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.577963 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] RBAC: Authorizing `identity:get_user(user_id=a2e52d201b7d46fc8249f814b80746d6)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.579655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.581388 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 129/258] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/users/a2e52d201b7d46fc8249f814b80746d6 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.581976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.598889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.627365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.674326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf12e6-93c7-488a-a464-97a1c9af18b5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.684805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa240a1-e021-4ac4-9d2c-7006571bb1db None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.710632 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.711665 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.712401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.713074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.713898 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:47.714486 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.716906 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.720026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.720718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.721063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.721395 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] PATH_INFO: `/v3/users/07095b000ad24c1da2f8d3f319c81063` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.722642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] RBAC: Authorizing `identity:get_user(user_id=07095b000ad24c1da2f8d3f319c81063)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.724144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.725936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 130/259] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/users/07095b000ad24c1da2f8d3f319c81063 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.726745 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.727248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 130/260] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.732908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.816714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.864137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eb7e8-b5f1-4073-966b-5d1f866bd18e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.867645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38dd61-88df-4335-83d9-4d4b5b5ff4db None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:47.886045 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:47.907326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.908459 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.908878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.909287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.971165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:47.971907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:47.972246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:47.972599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:47.979165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.980705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:47.982379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 131/261] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:47.983177 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:47.983837 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:47.985489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:48.160991 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60553e-28f9-45fc-a877-49a7a4188712 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:48.165354 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 131/262] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:32:48.166469 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:48.190753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:48.239062 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:48.241109 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:48.242180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:48.242888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] PATH_INFO: `/v3/users/07095b000ad24c1da2f8d3f319c81063` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:48.245303 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] RBAC: Authorizing `identity:get_user(user_id=07095b000ad24c1da2f8d3f319c81063)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:48.247761 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:48.250124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 132/263] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:47 2022] GET /identity/v3/users/07095b000ad24c1da2f8d3f319c81063 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:48.253815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:48.292142 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:48.318917 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b865-23e5-4155-a556-b7bcc4ed1966 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:48.377785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:48.378468 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:48.378740 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:48.379002 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e/users/a2e52d201b7d46fc8249f814b80746d6/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:48.380812 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09284694-89f4-4241-9482-3c6771968cfd None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:48.381011 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=436ab180354048eea2ec3859c35fb16e, user_id=a2e52d201b7d46fc8249f814b80746d6, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:48.382412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:48.407094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:48 2022] PUT /identity/v3/projects/436ab180354048eea2ec3859c35fb16e/users/a2e52d201b7d46fc8249f814b80746d6/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:48.408218 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:48.420005 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:48.420981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:48.421452 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:48.421914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:48.423339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:48.425058 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:48.427207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:48 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:48.435806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:48.596761 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:48.630177 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68b280-3575-4d2f-9fd2-7238ec4c46f3 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:48.648730 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:48.689573 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:48.690549 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:48.691215 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:48.691679 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:48.692622 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=07095b000ad24c1da2f8d3f319c81063) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:48.693123 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:48.694798 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:48.701645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 134/266] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:48 2022] GET /identity/v3/role_assignments?user.id=07095b000ad24c1da2f8d3f319c81063&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=0f13813da5a84a44829df58f1d837465 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:48.712583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83428656-5d84-44e9-8458-1529c21e3eeb None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:48.773327 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:48.774068 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:48.774376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:48.774703 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:48.871010 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:48.872597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:48.959089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:48.987186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 133/267] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:48.993169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:49.136196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05af1-6d37-483e-98fe-3309121b138a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:49.186315 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2ee3f-aa2a-4d29-9eba-200f28bb38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:49.186974 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2ee3f-aa2a-4d29-9eba-200f28bb38b3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:49.187248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2ee3f-aa2a-4d29-9eba-200f28bb38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:49.187512 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2ee3f-aa2a-4d29-9eba-200f28bb38b3 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:49.188710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2ee3f-aa2a-4d29-9eba-200f28bb38b3 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:49.190161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2ee3f-aa2a-4d29-9eba-200f28bb38b3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:49.192110 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 135/268] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:48 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:49.197976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:49.333534 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0ba58-a4b1-4a63-80fa-745de0017990 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:49.383444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:49.384098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:49.384379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:49.384655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:49.385424 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] RBAC: Adding query filter params (role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=07095b000ad24c1da2f8d3f319c81063) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:49.385734 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:49.387379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f76e4-c1ce-4dbc-97f5-a0b295595ae2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:49.394889 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 134/269] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:49 2022] GET /identity/v3/role_assignments?user.id=07095b000ad24c1da2f8d3f319c81063&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=d8b807df19b642feae1864b059dea9cf => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:49.527389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ac08-6d66-4c7a-92b6-29615241cab1 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:49.528354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ac08-6d66-4c7a-92b6-29615241cab1 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:49.528842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ac08-6d66-4c7a-92b6-29615241cab1 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:49.530398 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 136/270] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:49.536297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:49.536856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:49.537410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:49.558383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7942e-e61e-46a1-b833-6b09937f926d None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:49.558741 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7942e-e61e-46a1-b833-6b09937f926d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:49.558952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7942e-e61e-46a1-b833-6b09937f926d None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:49.560482 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 137/271] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:49.566311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:49.566949 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:49.567446 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:49.570348 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:49.573871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:49.601532 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:49.604962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:49.630831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:49.646011 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:49.693465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 135/272] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:49.708180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:50.050869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.072090 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.172139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df15ee-bf87-422c-b3c5-8deb63e51ebd None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:50.198503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a2d8f-dcea-490b-a723-a2ae29d8d0bc None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:50.220747 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:50.221895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.222367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.222830 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.234702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:50.235427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.235689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.236120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.236757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:50.237304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:50.238874 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:50.245255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 139/274] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:50.245377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:50.246188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:50.247080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:50.250516 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 136/275] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:50.251106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.252976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.275182 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:50.293139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:50.359658 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6da0f-5592-487e-a617-02c2079ee650 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:50.363595 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab0814-04a4-4715-925b-d6c4b8d9dbb5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:50.396613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454d8c7-a11f-4642-bd02-375099544dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:50.397370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d8c7-a11f-4642-bd02-375099544dd6 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.397647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d8c7-a11f-4642-bd02-375099544dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.397913 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d8c7-a11f-4642-bd02-375099544dd6 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.398593 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d8c7-a11f-4642-bd02-375099544dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:50.399174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:50.399993 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.400314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d8c7-a11f-4642-bd02-375099544dd6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:50.400651 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.401102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.401967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] RBAC: Adding query filter params (name=member) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:50.402476 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:50.404019 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cabe-5647-4e34-a570-3688c2f8a21d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:50.412936 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 137/276] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:50.414423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f38439-d31d-4f13-b3c2-31fac7ebf7e0 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.414940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f38439-d31d-4f13-b3c2-31fac7ebf7e0 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.415216 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f38439-d31d-4f13-b3c2-31fac7ebf7e0 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.420366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 138/277] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:50.420366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f38439-d31d-4f13-b3c2-31fac7ebf7e0 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.430763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 140/278] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:32:50 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:50.431924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.432207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.432477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.462015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:50.463669 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:50.536779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:50.545341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 141/279] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:50.552033 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f38439-d31d-4f13-b3c2-31fac7ebf7e0 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:50.592073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:50.593095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.593594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.594060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] PATH_INFO: `/v3/users/56c17c7a1a014118b048272f6c0c5197` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.610341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] RBAC: Authorizing `identity:get_user(user_id=56c17c7a1a014118b048272f6c0c5197)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:50.612350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:50.618546 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 139/280] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:50 2022] GET /identity/v3/users/56c17c7a1a014118b048272f6c0c5197 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:50.621100 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.623831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:50.738242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28675b2-0b27-474b-b6d7-b10aab2a9aec None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:50.776327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:50.777229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:50.777671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:50.778102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:50.779029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, user.id=56c17c7a1a014118b048272f6c0c5197, scope.system=all) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:50.779524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:50.781130 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:50.786792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 142/281] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 27 20:32:50 2022] GET /identity/v3/role_assignments?user.id=56c17c7a1a014118b048272f6c0c5197&scope.system=all&role.id=ea04e85c0aa7408095b855be56c86503 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:50.872233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:50.988361 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a53a6-8f66-433f-832b-eee718bf78db None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:51.023863 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:51.024965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.025438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.025918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.036917 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:51.042212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:51.043230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:51.044223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:51.046496 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 140/282] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:51.054479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:51.148780 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:51.192027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651352c7-a131-41cf-aaa7-df0e6eb8059f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:51.234900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:51.235521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.235796 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.236063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.236740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:51.237040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:51.238491 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966c64e-365e-4d49-8631-3d33821eb156 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:51.250049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 143/283] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:51.255745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:51.278808 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:51.346077 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ccc7f-9d44-492a-8827-673846b183e8 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.346338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ccc7f-9d44-492a-8827-673846b183e8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.346638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ccc7f-9d44-492a-8827-673846b183e8 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.348680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 144/284] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:51.355100 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.359985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.359985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.391969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:51.393195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:51.428249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433a7d0-1560-4645-b2d7-9e09bb83eb36 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:51.489949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:51.490528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.490807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.491073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] PATH_INFO: `/v3/users/a49d7bf5c2a7464787b6135056884e2e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.492345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] RBAC: Authorizing `identity:get_user(user_id=a49d7bf5c2a7464787b6135056884e2e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:51.493859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:51.496644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 141/285] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:51 2022] GET /identity/v3/users/a49d7bf5c2a7464787b6135056884e2e => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:51.501953 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:51.517632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 145/286] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:51.621295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:51.647840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df812ca-8f4d-4583-b4cd-75a1a9673199 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:51.697691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:51.698316 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.698628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.698897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.703114 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:51.704611 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:51.706621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 142/287] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:51 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:51.713433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:51.809703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:51.852312 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f55b73-27a9-4e76-a0d6-e10f3bf44f11 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:51.897237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:51.897930 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:51.898211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:51.898512 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e/users/a49d7bf5c2a7464787b6135056884e2e/roles/71cf3b3bee4f4e2493f9c9deb997fde1` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:51.900544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] RBAC: Authorizing `identity:create_grant(project_id=436ab180354048eea2ec3859c35fb16e, user_id=a49d7bf5c2a7464787b6135056884e2e, role_id=71cf3b3bee4f4e2493f9c9deb997fde1)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:51.902011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:51.918212 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 146/288] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:32:51 2022] PUT /identity/v3/projects/436ab180354048eea2ec3859c35fb16e/users/a49d7bf5c2a7464787b6135056884e2e/roles/71cf3b3bee4f4e2493f9c9deb997fde1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:52.007133 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:52.143813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa7557-d6e6-4425-ae54-e579fffa2b68 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:52.196742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:52.197395 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:52.197672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:52.197941 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:52.212604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:52.217869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:52.218764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:52.219615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 143/289] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:52.225074 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:52.330406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764d36f-5a0f-4786-872e-fd6f4bf66438 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:52.349308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:52.368352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:52.369213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:52.369489 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:52.369760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:52.370433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:52.370761 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:52.372200 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:52.381070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 147/290] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:52.386723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:52.399186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:52.496008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353af4-84a8-4a41-a32f-44c556a53b7f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:52.531457 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:52.532094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:52.532369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:52.532642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] PATH_INFO: `/v3/users/a2e52d201b7d46fc8249f814b80746d6` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:52.533841 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] RBAC: Authorizing `identity:get_user(user_id=a2e52d201b7d46fc8249f814b80746d6)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:52.535365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:52.537248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 144/291] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:52 2022] GET /identity/v3/users/a2e52d201b7d46fc8249f814b80746d6 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:52.543112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:52.648171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89985-74fc-4f0a-b305-307f76dfbff1 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:52.683003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:52.683586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:52.683864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:52.684191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:52.742916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:52.756922 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:52.758576 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:52.861001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 148/292] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:52.866968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:52.976445 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:53.009208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980def-b90a-4132-b8d0-793fab0e0397 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:53.064162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68375201-baee-4bb9-9398-6d14caf3109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:53.064797 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375201-baee-4bb9-9398-6d14caf3109f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.065072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375201-baee-4bb9-9398-6d14caf3109f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.065339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68375201-baee-4bb9-9398-6d14caf3109f None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.071161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68375201-baee-4bb9-9398-6d14caf3109f None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:53.072633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68375201-baee-4bb9-9398-6d14caf3109f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:53.074653 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 145/293] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:52 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:53.080402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:53.222828 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:53.257414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a9568-bb95-46c9-bb98-659a2e21bd93 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:53.312879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:53.313507 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.313784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.314054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.314934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=a2e52d201b7d46fc8249f814b80746d6) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:53.315253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:53.316740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f691922-7edd-4d66-be15-afec6297c685 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:53.317232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25474c0-aaf3-4721-8c57-5ed38c6e65a5 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.317521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25474c0-aaf3-4721-8c57-5ed38c6e65a5 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.317792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25474c0-aaf3-4721-8c57-5ed38c6e65a5 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.319166 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 146/294] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:53.327001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 149/295] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:53 2022] GET /identity/v3/role_assignments?user.id=a2e52d201b7d46fc8249f814b80746d6&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=ea04e85c0aa7408095b855be56c86503 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:53.327932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26e91b-afac-4f14-b2d2-9ace389aff97 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.328214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26e91b-afac-4f14-b2d2-9ace389aff97 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.328482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26e91b-afac-4f14-b2d2-9ace389aff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.359652 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-be26e91b-afac-4f14-b2d2-9ace389aff97 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:53.360920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-be26e91b-afac-4f14-b2d2-9ace389aff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:53.399235 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a641-df8a-43c5-a250-efe10a5307d3 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.399734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a641-df8a-43c5-a250-efe10a5307d3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.400046 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951a641-df8a-43c5-a250-efe10a5307d3 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.402104 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 150/296] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:53.411608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d644f-2eb7-439b-ab46-5d4dfd331ed8 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.412047 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d644f-2eb7-439b-ab46-5d4dfd331ed8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.412426 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d644f-2eb7-439b-ab46-5d4dfd331ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.434421 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-648d644f-2eb7-439b-ab46-5d4dfd331ed8 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:53.436133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-648d644f-2eb7-439b-ab46-5d4dfd331ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:53.501313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 147/297] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:53.515374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc67cc-9f71-4c62-8da3-e87cf642f3cb None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.515564 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc67cc-9f71-4c62-8da3-e87cf642f3cb None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.515941 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc67cc-9f71-4c62-8da3-e87cf642f3cb None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.517225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 151/298] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:53.517353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 148/299] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:32:53.524508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:53.524802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:53.525053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:53.552824 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:53.554039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:53.630346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 152/300] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:32:53.860843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc67cc-9f71-4c62-8da3-e87cf642f3cb None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:53.912675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:53.916527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:53.944181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:53.969340 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc67cc-9f71-4c62-8da3-e87cf642f3cb None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.009361 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.009981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.010251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.010555 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.020536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:54.025566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:54.026418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 149/301] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:54.028121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.037404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af3ca-493a-4393-8ef1-ab883bcda5f9 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.075113 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.076076 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.076182 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.076401 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.087087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:54.092245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:54.093112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:54.093884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 153/302] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:54.094547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.147440 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f24a-ce17-47ce-990e-f1237a87ff49 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.162993 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:54.185815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.186762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.187216 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.187477 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.188593 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.190017 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.194556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 150/303] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:54.194556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.197490 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:54.205330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d76a1-2ecd-451d-a5e9-f34705e670d6 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.242787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.243429 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.243708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.243978 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.244644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:54.244944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.246331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.259934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 154/304] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:54.259934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.307825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5c3c-43c6-4cf5-a49d-af81752c04a7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.342916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.343951 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.344240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.344494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.345221 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] RBAC: Adding query filter params (name=member) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:54.345519 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.348014 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.362608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 151/305] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:54.362608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9c77-1312-439c-99b3-6bd9c9088e17 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.397298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:54.406709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.407305 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.407646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.407916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] PATH_INFO: `/v3/groups` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.408546 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.410001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.426093 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 155/306] 10.222.0.15 () {60 vars in 1134 bytes} [Sat Aug 27 20:32:54 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:54.427310 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.443374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:54.480573 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7e041-85bc-44ca-bba0-722b84073683 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.527802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.529449 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.530703 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.530939 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] PATH_INFO: `/v3/users/93450051d905427fa5c192d44c629b8d` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.549478 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] RBAC: Authorizing `identity:get_user(user_id=93450051d905427fa5c192d44c629b8d)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.551006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.553208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 152/307] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:54 2022] GET /identity/v3/users/93450051d905427fa5c192d44c629b8d => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:54.559734 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.572773 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f00139-9701-4931-be3a-1cb8809e1f64 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.612858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.613500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.613844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.614193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] PATH_INFO: `/v3/users/56c17c7a1a014118b048272f6c0c5197` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.615659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] RBAC: Authorizing `identity:get_user(user_id=56c17c7a1a014118b048272f6c0c5197)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.617206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.619343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 156/308] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:54 2022] GET /identity/v3/users/56c17c7a1a014118b048272f6c0c5197 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:54.627472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:54.680958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cf636-fbf6-4745-8470-9f0c15a4b44c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.695218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:54.713924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:54.727277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.727885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.728157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.728421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.729160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] RBAC: Adding query filter params (role.id=71cf3b3bee4f4e2493f9c9deb997fde1, user.id=93450051d905427fa5c192d44c629b8d, scope.system=all) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:54.729460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.731004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b624b-3987-481d-a8bb-9dec106dd1d3 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.736987 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 153/309] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 27 20:32:54 2022] GET /identity/v3/role_assignments?user.id=93450051d905427fa5c192d44c629b8d&scope.system=all&role.id=71cf3b3bee4f4e2493f9c9deb997fde1 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:54.770063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5528a-68ad-4c80-a00a-4d7f39b274e0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:54.810415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6ba23-2841-45e5-928a-bec5729bec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:54.811177 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ba23-2841-45e5-928a-bec5729bec70 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.811459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ba23-2841-45e5-928a-bec5729bec70 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.811729 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ba23-2841-45e5-928a-bec5729bec70 None admin] PATH_INFO: `/v3/system/users/56c17c7a1a014118b048272f6c0c5197/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.813260 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ba23-2841-45e5-928a-bec5729bec70 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=56c17c7a1a014118b048272f6c0c5197, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:54.814734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6ba23-2841-45e5-928a-bec5729bec70 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:54.827755 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 157/310] 10.222.0.15 () {58 vars in 1334 bytes} [Sat Aug 27 20:32:54 2022] PUT /identity/v3/system/users/56c17c7a1a014118b048272f6c0c5197/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:32:54.950345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca850b8-4818-45a6-bf11-6221e1c12828 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.950813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca850b8-4818-45a6-bf11-6221e1c12828 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.951090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca850b8-4818-45a6-bf11-6221e1c12828 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.952662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 154/311] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:54.961842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:54.962362 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:54.962362 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:54.983802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:54.985440 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:55.074400 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 158/312] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:55.402241 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca850b8-4818-45a6-bf11-6221e1c12828 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:55.512158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca850b8-4818-45a6-bf11-6221e1c12828 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:55.547657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:55.548327 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:55.548586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:55.548807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:55.559679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:55.564550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:55.565413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:55.566205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 155/313] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:55.573402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:55.626289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:55.680221 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e21c7-4c23-4405-aec3-747a4f58d076 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:55.719774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:55.720826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:55.721303 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:55.721762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:55.722650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:55.723145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:55.724719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:55.733782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 159/314] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:55.739676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:55.791894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:55.848339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a877-da20-4ab3-b0c4-1c6453b12f34 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:55.882739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:55.883434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:55.883725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:55.889571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] PATH_INFO: `/v3/users/a49d7bf5c2a7464787b6135056884e2e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:55.891053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] RBAC: Authorizing `identity:get_user(user_id=a49d7bf5c2a7464787b6135056884e2e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:55.897988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:55.900238 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 156/315] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:55 2022] GET /identity/v3/users/a49d7bf5c2a7464787b6135056884e2e => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:55.905916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:56.009651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbe9df-2d24-4f9f-8223-340d34030d85 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:56.020324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:56.044457 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:56.045056 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:56.045335 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:56.045601 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:56.115083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:56.116611 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:56.215781 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 160/316] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:32:56.221373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:56.325916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b98a9-9255-442e-854d-7c578b7a55a8 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:56.340678 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:56.361357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd7f3-9934-40f6-9f89-00b08a623007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:56.362075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd7f3-9934-40f6-9f89-00b08a623007 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:56.362402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd7f3-9934-40f6-9f89-00b08a623007 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:56.362720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd7f3-9934-40f6-9f89-00b08a623007 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:56.364142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd7f3-9934-40f6-9f89-00b08a623007 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:56.365760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd7f3-9934-40f6-9f89-00b08a623007 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:56.368051 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 157/317] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:32:56 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:56.374071 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:56.386810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:56.487253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7eec8-398c-42f2-a352-7dcd6f16a5b2 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:56.524730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:56.525441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:56.525713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:56.525978 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:56.526799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] RBAC: Adding query filter params (role.id=71cf3b3bee4f4e2493f9c9deb997fde1, scope.project.id=436ab180354048eea2ec3859c35fb16e, user.id=a49d7bf5c2a7464787b6135056884e2e) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:56.527162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:56.528789 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232558b3-3dfe-4df8-aac4-8bd01512eaeb None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:56.536140 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 161/318] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:32:56 2022] GET /identity/v3/role_assignments?user.id=a49d7bf5c2a7464787b6135056884e2e&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=71cf3b3bee4f4e2493f9c9deb997fde1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:56.838858 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba0cd-6eff-425d-bd21-385c811b41af None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:56.839395 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba0cd-6eff-425d-bd21-385c811b41af None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:56.839581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba0cd-6eff-425d-bd21-385c811b41af None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:56.841345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 158/319] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:56.846627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abeae0-9758-4637-89c3-d5f33f878956 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:56.846911 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abeae0-9758-4637-89c3-d5f33f878956 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:56.847281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abeae0-9758-4637-89c3-d5f33f878956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:56.866810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-b8abeae0-9758-4637-89c3-d5f33f878956 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:56.868066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-b8abeae0-9758-4637-89c3-d5f33f878956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:56.942492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 162/320] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:57.016786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ade6-c5c6-4752-a3ea-3ccef3c707d6 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.017311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ade6-c5c6-4752-a3ea-3ccef3c707d6 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.017470 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ade6-c5c6-4752-a3ea-3ccef3c707d6 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.019244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 159/321] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:57.024414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585c9c-f10e-4ccd-8540-588928f6c64b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.024897 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585c9c-f10e-4ccd-8540-588928f6c64b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.024897 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585c9c-f10e-4ccd-8540-588928f6c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.032412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:57.044215 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e7585c9c-f10e-4ccd-8540-588928f6c64b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:57.045418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e7585c9c-f10e-4ccd-8540-588928f6c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:57.113445 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 163/322] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:57.147977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82975094-9f19-4749-84c1-ced2d5ba31e4 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.148281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82975094-9f19-4749-84c1-ced2d5ba31e4 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.148482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82975094-9f19-4749-84c1-ced2d5ba31e4 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.150055 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 160/323] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:32:57.155101 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.155354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.155649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.174769 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:32:57.175938 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:32:57.243348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 164/324] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:32:57.262529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82975094-9f19-4749-84c1-ced2d5ba31e4 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.364620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82975094-9f19-4749-84c1-ced2d5ba31e4 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.399112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.399999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.400485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.400926 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.402301 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:57.404028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:57.410419 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 161/325] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:57.411739 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.434216 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.478016 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:57.495862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:57.518821 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f938a0-9e07-4e88-9a49-7e8189ee0b0e None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.548550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996103-3a53-423d-bc3e-0a61f23c3e9e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.552809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.553401 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.553665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.553920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] PATH_INFO: `/v3/groups` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.554581 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:57.556045 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:57.572849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 165/326] 10.222.0.15 () {60 vars in 1134 bytes} [Sat Aug 27 20:32:57 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:32:57.584341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.594381 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.595075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.595352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.595622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.608184 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:57.615765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:57.616870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:32:57.617948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 162/327] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:32:57.623365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.713445 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb2afc-a535-41a5-83c6-8ee54b04fe06 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.740570 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:57.753786 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.754112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681421d-ebaa-4e09-908b-956b530f1b23 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.754426 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.754733 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.755000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.766756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:57.769186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:32:57.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:32:57.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:32:57.776836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 166/328] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:32:57.782248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.798237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.798920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.799252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.799523 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.800239 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:57.800547 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:57.801984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:57.811002 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 163/329] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:57.817417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.914923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74142ab8-4a44-43d5-b795-466477697385 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.946297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c1bb3-2e01-4cf7-80ac-3ecdbec19049 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:57.957268 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.957880 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.958154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.958422 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.959126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:57.959448 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:57.960858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:57.970483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 167/330] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:57.978746 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:57.991266 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:57.992862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:57.993139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:57.993410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] PATH_INFO: `/v3/users/93450051d905427fa5c192d44c629b8d` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:57.994797 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] RBAC: Authorizing `identity:get_user(user_id=93450051d905427fa5c192d44c629b8d)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:57.996275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:57.997887 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 164/331] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/users/93450051d905427fa5c192d44c629b8d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:32:58.003684 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:58.034564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:58.051069 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:58.109350 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce29e25-585b-4a8d-8cbc-ed2f7a4384d7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:58.125179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8d85-2167-4e72-a35f-403566d34861 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:58.154184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:58.155054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:58.155787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:58.156136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] PATH_INFO: `/v3/users/56c17c7a1a014118b048272f6c0c5197` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:58.157596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] RBAC: Authorizing `identity:get_user(user_id=56c17c7a1a014118b048272f6c0c5197)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:58.159799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:58.162057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 168/332] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:32:57 2022] GET /identity/v3/users/56c17c7a1a014118b048272f6c0c5197 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:32:58.164757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0b4f5-89fb-4dd1-8a57-db23acbb1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:58.168076 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b4f5-89fb-4dd1-8a57-db23acbb1a1e None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:58.168191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:32:58.168790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b4f5-89fb-4dd1-8a57-db23acbb1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:58.169333 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0b4f5-89fb-4dd1-8a57-db23acbb1a1e None admin] PATH_INFO: `/v3/system/users/93450051d905427fa5c192d44c629b8d/roles/71cf3b3bee4f4e2493f9c9deb997fde1` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:58.171494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0b4f5-89fb-4dd1-8a57-db23acbb1a1e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=93450051d905427fa5c192d44c629b8d, role_id=71cf3b3bee4f4e2493f9c9deb997fde1)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:58.173162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0b4f5-89fb-4dd1-8a57-db23acbb1a1e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:58.184767 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 165/333] 10.222.0.15 () {58 vars in 1334 bytes} [Sat Aug 27 20:32:58 2022] PUT /identity/v3/system/users/93450051d905427fa5c192d44c629b8d/roles/71cf3b3bee4f4e2493f9c9deb997fde1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 20:32:58.281760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad59a6-634b-453a-8fba-1c8a4fde938b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:32:58.297281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:32:58.319139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:32:58.319757 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:32:58.320032 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:32:58.320300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:32:58.321095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] RBAC: Adding query filter params (role.id=ea04e85c0aa7408095b855be56c86503, user.id=56c17c7a1a014118b048272f6c0c5197, scope.system=all) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:32:58.321405 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:32:58.322906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba029c-f13e-43cb-b35e-c3624c9f3fdb None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:32:58.336595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 169/334] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 27 20:32:58 2022] GET /identity/v3/role_assignments?user.id=56c17c7a1a014118b048272f6c0c5197&scope.system=all&role.id=ea04e85c0aa7408095b855be56c86503 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:00.047909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3956-0940-4bdc-a8b5-a2be65dfbf29 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:00.048912 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3956-0940-4bdc-a8b5-a2be65dfbf29 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:00.049393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3956-0940-4bdc-a8b5-a2be65dfbf29 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:00.051047 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 166/335] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:00.056892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97035-e391-493a-b03e-3ca244012f60 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:00.057738 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97035-e391-493a-b03e-3ca244012f60 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:00.058208 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f97035-e391-493a-b03e-3ca244012f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:00.082131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c9f97035-e391-493a-b03e-3ca244012f60 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:00.083680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c9f97035-e391-493a-b03e-3ca244012f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:00.168037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 170/336] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:00.634205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db890cc-f761-4b9e-87c2-17924dfbb0d8 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:00.634964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db890cc-f761-4b9e-87c2-17924dfbb0d8 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:00.635485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db890cc-f761-4b9e-87c2-17924dfbb0d8 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:00.637122 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 167/337] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:00.642925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:00.643247 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:00.643473 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:00.666307 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:00.667863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:00.756981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 171/338] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:00.834055 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db890cc-f761-4b9e-87c2-17924dfbb0d8 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:00.965464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db890cc-f761-4b9e-87c2-17924dfbb0d8 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:00.967932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:01.011736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433d8d-71ec-4692-b7a5-6a2d397b0a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:01.012380 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433d8d-71ec-4692-b7a5-6a2d397b0a3e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.012664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433d8d-71ec-4692-b7a5-6a2d397b0a3e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.012934 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433d8d-71ec-4692-b7a5-6a2d397b0a3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.029787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433d8d-71ec-4692-b7a5-6a2d397b0a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-16433d8d-71ec-4692-b7a5-6a2d397b0a3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:01.034924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:01.035915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:01.036698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 168/339] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:01.042879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:01.088023 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:01.139149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e6932-c270-4aa2-9ab0-4f37666217dd None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.139662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e6932-c270-4aa2-9ab0-4f37666217dd None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.139662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e6932-c270-4aa2-9ab0-4f37666217dd None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.141033 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 169/340] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:01.147283 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b840e-7d25-4fd6-9226-5b9ff5c3eb27 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.147510 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b840e-7d25-4fd6-9226-5b9ff5c3eb27 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.147763 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b840e-7d25-4fd6-9226-5b9ff5c3eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.174150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-b00b840e-7d25-4fd6-9226-5b9ff5c3eb27 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:01.175384 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-b00b840e-7d25-4fd6-9226-5b9ff5c3eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:01.215752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b898294-716a-40c8-b39f-8afa2bc7082f None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:01.255730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:01.256349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.256632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.256901 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.257577 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:01.257942 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:01.259361 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:01.273336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 170/341] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:01.274475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab98c0-a43d-4cd5-939d-80be751a3cd4 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.274768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab98c0-a43d-4cd5-939d-80be751a3cd4 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.275252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab98c0-a43d-4cd5-939d-80be751a3cd4 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.276609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 171/342] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:01.278529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 172/343] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:01.290144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:01.290619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.290902 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.291188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.315648 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:01.316927 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:01.417976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 172/344] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:01.418825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:01.446966 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:01.485381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:01.497846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa574-e92f-412e-92e9-dfd548a50a26 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:01.530067 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00f390-b785-42ed-bb8d-c8d7c2f5b7a3 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:01.566663 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:01.567620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.568008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:01.568162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.568289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.569036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.569485 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.569924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.579238 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:01.584602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:01.585436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 20:33:01.586287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:01.588908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 173/345] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:01.594907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:01.695743 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e65ad5-61fd-4c15-8ef3-0ec7a918a0f6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:01.698756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:01.724321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:01.725829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:01.736230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:01.737333 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.738016 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.738325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:01.739759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:01.740103 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:01.742092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:01.759615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 174/346] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:01.760821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:01.851576 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:01.868415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 173/347] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:01.869312 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:01.942686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c57651-8fe1-49d8-9a93-c0cb87681467 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:01.990252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:01.991152 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:01.991638 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:01.992418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.005629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:02.013295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:02.014505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:02.015538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:02.017243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ca011-5c44-4a18-9d80-68b109309f41 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.017715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 175/348] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:02.022802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.038232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.067885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.069057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.069533 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.069998 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] PATH_INFO: `/v3/users/93450051d905427fa5c192d44c629b8d` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.071573 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] RBAC: Authorizing `identity:get_user(user_id=93450051d905427fa5c192d44c629b8d)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.074032 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.075867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 174/349] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 27 20:33:01 2022] GET /identity/v3/users/93450051d905427fa5c192d44c629b8d => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.077279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.153456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e0a3a-3e8b-4dbf-b23e-69b11bd2dc7c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.156905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.190905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.191496 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.191773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.192039 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.193243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.194736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.200933 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5f68-c511-4482-b82b-6f6f8e9683d9 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.201660 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 176/350] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.202983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.240835 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.242056 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.242612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.243081 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.254931 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:02.260629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:02.261499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:02.262314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:02.264712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 175/351] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:02.265707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.289905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.318982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168e4d-25c4-4121-a090-c4970e62b015 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.375084 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.376053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.377069 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.377570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.378803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:02.379545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.381233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.391132 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00362-b496-4b58-9c1b-246b925cc68e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.395647 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 177/352] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.396769 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.418550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.437935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.439388 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.439665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.439929 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.440658 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] RBAC: Adding query filter params (role.id=71cf3b3bee4f4e2493f9c9deb997fde1, user.id=93450051d905427fa5c192d44c629b8d, scope.system=all) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:02.440958 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.442404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.457169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 176/353] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/role_assignments?user.id=93450051d905427fa5c192d44c629b8d&scope.system=all&role.id=71cf3b3bee4f4e2493f9c9deb997fde1 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.458299 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.531199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625e12e-7f9d-4218-9f57-f154debc7b18 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.582620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae6295-32af-4b39-9c7f-25c04b765805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.583271 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6295-32af-4b39-9c7f-25c04b765805 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.583552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6295-32af-4b39-9c7f-25c04b765805 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.583819 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6295-32af-4b39-9c7f-25c04b765805 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.589454 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.593252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae6295-32af-4b39-9c7f-25c04b765805 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.595056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae6295-32af-4b39-9c7f-25c04b765805 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.602618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 178/354] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.605799 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075006-812e-4697-80ec-c20a15a8a43e None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.606398 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075006-812e-4697-80ec-c20a15a8a43e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.608509 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5b074-0b49-475a-9323-87e65f401d0e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.608965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075006-812e-4697-80ec-c20a15a8a43e None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.610535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 179/355] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:02.613169 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7075006-812e-4697-80ec-c20a15a8a43e None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.652895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.653935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.654478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.655028 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.656058 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:02.656553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.658142 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.668331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 177/356] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.669585 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:02.722919 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.737984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7075006-812e-4697-80ec-c20a15a8a43e None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.787223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.787755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.788105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.788375 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.816630 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc65199-304e-4fee-a81c-133b01496a5b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:02.865132 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:02.865808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.866082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.866288 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.867081 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=6db042a0872b4a3ea922675cac1ff64c) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:02.867393 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.868838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcdafd-392e-44fa-b6b7-c06bad51fa49 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.870974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:02.873705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:02.875496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 178/357] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=ea04e85c0aa7408095b855be56c86503 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:02.875610 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:02.883537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:02.884160 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:02.884621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:02.910652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:02.912959 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:03.009226 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 179/358] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:03.015593 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.019237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 180/359] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:03.024512 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.088683 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.157158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.160351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707246-ce7b-4438-93e7-30892dd78cbe None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.199373 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24de9a-6094-4593-be6b-3fe2c65d01d1 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.206396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429809-ee7b-49cc-80b8-beff060064f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.207189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429809-ee7b-49cc-80b8-beff060064f4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.207563 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429809-ee7b-49cc-80b8-beff060064f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.207975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429809-ee7b-49cc-80b8-beff060064f4 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.209237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429809-ee7b-49cc-80b8-beff060064f4 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.211149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429809-ee7b-49cc-80b8-beff060064f4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.217792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 181/360] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:03.219240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501107f0-b385-4d1f-b219-5ec90cea46a7 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.219616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501107f0-b385-4d1f-b219-5ec90cea46a7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.219984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501107f0-b385-4d1f-b219-5ec90cea46a7 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.221633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 182/361] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:03.222509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501107f0-b385-4d1f-b219-5ec90cea46a7 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.241231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.242378 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.242814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.243237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.330734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.333062 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.341286 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501107f0-b385-4d1f-b219-5ec90cea46a7 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.377545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.381047 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d440-e28b-422f-a0c3-128943994364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.382396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d440-e28b-422f-a0c3-128943994364 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.382396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d440-e28b-422f-a0c3-128943994364 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.382804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d440-e28b-422f-a0c3-128943994364 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.384201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d440-e28b-422f-a0c3-128943994364 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.386751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d440-e28b-422f-a0c3-128943994364 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.388429 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 183/362] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:03.389748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.396142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.396895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.417297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:03.418768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:03.456808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 180/363] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:03.457681 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.459086 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.514154 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 184/364] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:03.515072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.591742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04b45f-0c79-4154-aaf3-f0adb8e4bf8d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.627818 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.628421 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.628699 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.628968 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.629691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=6db042a0872b4a3ea922675cac1ff64c) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:03.630039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.631667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.634787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.637465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e938247-db60-47d2-9492-b2bf3b9cd400 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.637925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 181/365] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=d8b807df19b642feae1864b059dea9cf => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:03.638801 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.675350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.676171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.676453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.676722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.689488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:03.694482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:03.695513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:03.696389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:03.702030 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 185/366] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:03.703400 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.742510 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.750848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf6d75-78ff-4cd1-8fcc-801ca0d77ca5 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.794275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.794962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.795268 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.795503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.800981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.802515 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.804411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 182/367] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:03.810176 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.823690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffab9e-30af-440a-8afc-22140652b61f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.861983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.862947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.863400 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.863842 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.864691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:03.865164 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.866774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.882927 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 186/368] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:03.884680 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:03.918436 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:03.927865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf85a4-3555-471e-8dbd-657ab70432ec None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:03.977102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:03.977787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:03.978063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:03.978332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:03.979619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:03.981166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:03.983895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 183/369] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:03.984719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.009184 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.024257 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6df83d-c703-4882-9d79-16c179f06669 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.065035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.066183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.066984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.067722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.113763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc9382-6b59-4e80-8f2e-7b2f19808ca0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.155440 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.156091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.156717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.156717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.158992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:04.161275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:04.162410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.172165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:04.178717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:04.179725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:04.180547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 184/370] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:04.181206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.279460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.294905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 187/371] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:04.296206 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.353813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ad168-bec6-46eb-a8b1-680084cb0c3c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.404125 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.404660 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.405000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.405276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.406059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=436ab180354048eea2ec3859c35fb16e) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:04.406372 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:04.408461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:04.416462 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 185/372] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=ea04e85c0aa7408095b855be56c86503 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:04.417663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.437654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e22912-3579-429e-a081-4b422d6e79e9 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.485043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.485667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.485945 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.486216 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.486930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:04.487230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:04.489335 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:04.493239 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.501048 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 188/373] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:04.507088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.555218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dca9f-9074-4767-9cd8-48218f0d6945 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.568613 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.596682 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.597850 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.598341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.598893 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.600237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:04.602039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:04.604136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 186/374] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:04.612317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.639634 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc68e-80b3-4824-b9f8-361be4302ee6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.683866 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.684371 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.684654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.684924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.734162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408ca0-f235-47b8-96a0-5ac165793cd7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:04.781063 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:04.781732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.782601 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:04.798980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369535-3ad1-43aa-8456-37362498030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:04.800000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369535-3ad1-43aa-8456-37362498030a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:04.800486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369535-3ad1-43aa-8456-37362498030a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:04.800960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369535-3ad1-43aa-8456-37362498030a None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:04.803180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62369535-3ad1-43aa-8456-37362498030a None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:04.804938 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62369535-3ad1-43aa-8456-37362498030a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:04.809223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 187/375] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:04.815034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369535-3ad1-43aa-8456-37362498030a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:04.854592 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:04.908487 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 189/376] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:33:04.920027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:05.016291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369535-3ad1-43aa-8456-37362498030a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:05.044380 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dce77-8049-4405-a30b-b5615e2f8aa7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:05.085606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:05.086597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:05.087055 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:05.087499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] PATH_INFO: `/v3/projects/fff777f39d5941018014cff100fff5ca` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:05.089185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] RBAC: Authorizing `identity:get_project(project_id=fff777f39d5941018014cff100fff5ca)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:05.091262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:05.092757 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:05.093213 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 190/377] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/projects/fff777f39d5941018014cff100fff5ca => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:05.095009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:05.095009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:05.095009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:05.096055 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=436ab180354048eea2ec3859c35fb16e) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:05.096584 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:05.098964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:05.103547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:05.118145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 188/378] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:04 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=d8b807df19b642feae1864b059dea9cf => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:05.134404 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:05.239143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283f9f5-2a96-4402-b4fe-7ea040ffd29b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:05.276027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d2b3a-252a-490b-9b94-79a1291e28f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:05.276592 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2b3a-252a-490b-9b94-79a1291e28f8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:05.276867 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2b3a-252a-490b-9b94-79a1291e28f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:05.277140 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2b3a-252a-490b-9b94-79a1291e28f8 None admin] PATH_INFO: `/v3/groups/1bf56589bb9848a6903f3d0d1c7611a9` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:05.282864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d2b3a-252a-490b-9b94-79a1291e28f8 None admin] RBAC: Authorizing `identity:get_group(group_id=1bf56589bb9848a6903f3d0d1c7611a9)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:05.284323 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d2b3a-252a-490b-9b94-79a1291e28f8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:05.286329 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 191/379] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:05 2022] GET /identity/v3/groups/1bf56589bb9848a6903f3d0d1c7611a9 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:05.292632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:05.363584 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:05.418620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cadeb-c78b-4c33-bcdd-5a6f169b6537 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:05.459200 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:05.459812 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:05.460133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:05.460402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:05.461208 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] RBAC: Adding query filter params (group.id=1bf56589bb9848a6903f3d0d1c7611a9, role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=fff777f39d5941018014cff100fff5ca) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:05.461513 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:05.463139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb5dc-9765-4ff3-8c0a-8f5c78dcdc94 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:05.470330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 189/380] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:05 2022] GET /identity/v3/role_assignments?group.id=1bf56589bb9848a6903f3d0d1c7611a9&scope.project.id=fff777f39d5941018014cff100fff5ca&role.id=0f13813da5a84a44829df58f1d837465 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:05.542207 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824485-d156-4ad4-9024-95fdbffc35bd None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:05.542528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824485-d156-4ad4-9024-95fdbffc35bd None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:05.542705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824485-d156-4ad4-9024-95fdbffc35bd None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:05.544111 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 192/381] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:05.549859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:05.550153 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:05.550403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:05.572565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:05.574106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:05.647261 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 190/382] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:05.990973 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824485-d156-4ad4-9024-95fdbffc35bd None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:06.088991 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:06.110746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824485-d156-4ad4-9024-95fdbffc35bd None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:06.165712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:06.166274 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:06.166581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:06.166852 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:06.180525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:06.185405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:06.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:06.187236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 193/383] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:06.194310 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:06.278790 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:06.325026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf81ce-5c79-4655-bd6f-e6c166296c5c None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:06.361620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:06.362231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:06.362523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:06.362791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:06.363461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:06.363751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:06.365117 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:06.375267 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 191/384] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:06.380868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:06.489752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15291c-c40e-4f66-af83-c2eb01e5a999 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:06.540649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21822ae9-5e7f-468d-b3a3-e283ad0549c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:06.541341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822ae9-5e7f-468d-b3a3-e283ad0549c2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:06.541622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822ae9-5e7f-468d-b3a3-e283ad0549c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:06.541894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21822ae9-5e7f-468d-b3a3-e283ad0549c2 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:06.543215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21822ae9-5e7f-468d-b3a3-e283ad0549c2 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:06.544725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21822ae9-5e7f-468d-b3a3-e283ad0549c2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:06.546722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 194/385] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:06 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:06.552013 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:06.693837 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa0062-d713-462d-ad30-934ad422d993 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:06.694025 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255749-c038-48b9-903d-aa5e657db033 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:06.694218 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255749-c038-48b9-903d-aa5e657db033 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:06.694681 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255749-c038-48b9-903d-aa5e657db033 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:06.696309 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 195/386] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:06.702910 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:06.703480 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:06.703940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:06.723363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:06.740640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:06.741783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:06.750696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:06.763943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:06.764579 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:06.764851 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:06.765264 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:06.767415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:06.768871 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:06.780500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 192/387] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:06 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:06.787521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:06.897724 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 196/388] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:06.989050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2921a7-732c-402f-8c46-0b359806e109 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:07.036747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:07.037353 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:07.037627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:07.037895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c/groups/04c1a651872f4ef684a81750da5c474a/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:07.040129 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db042a0872b4a3ea922675cac1ff64c, group_id=04c1a651872f4ef684a81750da5c474a, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:07.041625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:07.061535 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 193/389] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 27 20:33:06 2022] PUT /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c/groups/04c1a651872f4ef684a81750da5c474a/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:07.395229 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:07.507709 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5f53-07ae-42c3-9e7c-4c6e288f652a None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:07.544624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae5ea5-5398-4dd3-8a26-191df0b7a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:07.545624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae5ea5-5398-4dd3-8a26-191df0b7a540 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:07.546121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae5ea5-5398-4dd3-8a26-191df0b7a540 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:07.546624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae5ea5-5398-4dd3-8a26-191df0b7a540 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:07.554987 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:07.559307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae5ea5-5398-4dd3-8a26-191df0b7a540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-53ae5ea5-5398-4dd3-8a26-191df0b7a540 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:07.564509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:07.565378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:07.566151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:07.568636 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 197/390] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:07.574785 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:07.595675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf653-b248-4d40-a8d9-be52d2ccddb0 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:07.595993 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf653-b248-4d40-a8d9-be52d2ccddb0 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:07.596265 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf653-b248-4d40-a8d9-be52d2ccddb0 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:07.598481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 198/391] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:07.603814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:07.604178 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:07.604525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:07.625460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:07.626859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:07.637355 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:07.707214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 199/392] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:07.730420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57f50-c0c2-4d45-b7c4-757407388ad7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:07.776039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:07.776978 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:07.777429 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:07.777884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:07.778752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:07.779243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:07.780794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:07.794695 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 194/393] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:07.800689 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:07.932208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74263-de3b-4f07-8ad6-87e99fce9d3f None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:07.968885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:07.975456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:07.976093 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:07.976437 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:07.976710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:07.983115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:07.984572 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:07.986548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 200/394] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:07 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:07.992626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:08.132123 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9225f3-c526-4296-893c-16e00df308d1 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:08.139996 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:08.171420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:08.172059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.172329 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.172596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.173823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:08.175321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:08.177301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 195/395] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:07 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:08.183211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:08.239205 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:08.306687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f8089-eed9-49de-9ff2-5372fbc550ca None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:08.371524 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206e543-6440-40d1-822e-930002a4547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:08.372557 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e543-6440-40d1-822e-930002a4547c None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.373090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e543-6440-40d1-822e-930002a4547c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.373566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e543-6440-40d1-822e-930002a4547c None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c/groups/04c1a651872f4ef684a81750da5c474a/roles/d8b807df19b642feae1864b059dea9cf` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.377756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206e543-6440-40d1-822e-930002a4547c None admin] RBAC: Authorizing `identity:create_grant(project_id=6db042a0872b4a3ea922675cac1ff64c, group_id=04c1a651872f4ef684a81750da5c474a, role_id=d8b807df19b642feae1864b059dea9cf)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:08.379457 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206e543-6440-40d1-822e-930002a4547c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:08.384720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b270-51dd-4625-a0b0-78b339f11839 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:08.396300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 201/396] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 27 20:33:08 2022] PUT /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c/groups/04c1a651872f4ef684a81750da5c474a/roles/d8b807df19b642feae1864b059dea9cf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:08.398381 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf27ef-7c07-4fa4-8227-48c5b40268ac None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.398908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf27ef-7c07-4fa4-8227-48c5b40268ac None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.399391 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf27ef-7c07-4fa4-8227-48c5b40268ac None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.401324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 202/397] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:08.419032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bbebb-8b56-4d24-90d4-5b47e54754b0 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.419783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bbebb-8b56-4d24-90d4-5b47e54754b0 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.420252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bbebb-8b56-4d24-90d4-5b47e54754b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.431073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5133-2130-4286-a9b0-5d89d2adc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:08.431838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5133-2130-4286-a9b0-5d89d2adc38a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.432153 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5133-2130-4286-a9b0-5d89d2adc38a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.432428 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5133-2130-4286-a9b0-5d89d2adc38a None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.445431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5133-2130-4286-a9b0-5d89d2adc38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:08.446692 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-0c3bbebb-8b56-4d24-90d4-5b47e54754b0 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:08.448131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-0c3bbebb-8b56-4d24-90d4-5b47e54754b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-95ea5133-2130-4286-a9b0-5d89d2adc38a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:08.451481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:08.452413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:08.453198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 196/398] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:08.459539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63fd4-e6af-434f-b5cb-732ea5c8c6c6 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.459539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63fd4-e6af-434f-b5cb-732ea5c8c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.459539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c63fd4-e6af-434f-b5cb-732ea5c8c6c6 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.459539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 197/399] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:08.462691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63fd4-e6af-434f-b5cb-732ea5c8c6c6 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:08.514246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:08.533674 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:08.562929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 203/400] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:08.562929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.562929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.562929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.595254 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:08.596441 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:08.616247 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c63fd4-e6af-434f-b5cb-732ea5c8c6c6 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:08.657494 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:08.658211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.658594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.658867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.659595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:08.659895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:08.661535 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:08.671834 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 198/401] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:08.673356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 204/402] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:08.677627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:08.779496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:08.787059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc154-30b8-4481-815a-3792b94dcc11 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:08.829996 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:08.830697 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:08.830979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:08.831247 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:08.832378 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:08.833981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:08.835927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 199/403] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:08 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:08.841763 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:08.954065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fb72e-ab38-4011-8a3f-211db20a7592 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:08.972422 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:08.979213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.015005 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.015656 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.015940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.016219 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.017374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.019397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.025028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 205/404] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:08 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:09.030565 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.155187 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99251d-771b-4c28-8538-e0bde3931a39 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.189157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e0512-ab84-4e04-91a5-e254f71eceba None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.198717 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.199954 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.200409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.201126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.214634 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:09.221854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:09.222774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:09.223563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:09.225946 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 200/405] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:09.227181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.228083 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.228864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.229241 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.229606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e/groups/04c1a651872f4ef684a81750da5c474a/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.231807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] RBAC: Authorizing `identity:create_grant(project_id=436ab180354048eea2ec3859c35fb16e, group_id=04c1a651872f4ef684a81750da5c474a, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.233493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.258493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 206/406] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 27 20:33:09 2022] PUT /identity/v3/projects/436ab180354048eea2ec3859c35fb16e/groups/04c1a651872f4ef684a81750da5c474a/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 20:33:09.258493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.266088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:09.309241 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:09.350228 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b6ed6-8940-491d-9edb-c5e68a07700e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.374358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb1bce-1e45-461a-b6f9-8d28da0fe66e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.389082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.390119 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.390579 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.391094 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.402784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:09.408747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:09.409691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:09.410952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:09.413084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 201/407] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:09.413843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.419482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.419928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.420209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.421001 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:09.421314 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.421540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.422881 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.433311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 207/408] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:09.442861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.515997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:09.534155 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a9e6-cad1-4630-a171-d6f0e97d3d61 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.591071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa50a2-592c-41db-9bda-f1fbea9187f7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.604967 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.607106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.607106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.607106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.607106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:09.607106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.608552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.611620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:09.623530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 202/409] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:09.629723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.646298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.647527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.647948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.648600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.650375 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.652648 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.655029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 208/410] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:09.660194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.777778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df22f8-b68b-484c-a84b-e5fcfa65b627 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.816526 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.817674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.818147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.818780 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] PATH_INFO: `/v3/groups/1bf56589bb9848a6903f3d0d1c7611a9` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.820302 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] RBAC: Authorizing `identity:get_group(group_id=1bf56589bb9848a6903f3d0d1c7611a9)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.822087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.824303 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 203/411] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/groups/1bf56589bb9848a6903f3d0d1c7611a9 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:09.831150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.850740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:09.859602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1042a8b-ef0c-4712-a8c3-66f8efc17668 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.951461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfbf1e-4c74-45a6-b80e-65ed14ed8ca3 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:09.967453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.967825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.968106 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.968377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.972498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.973975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.975972 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 209/412] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:09.983319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:09.990030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:09.991019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:09.991518 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:09.992042 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] PATH_INFO: `/v3/projects/fff777f39d5941018014cff100fff5ca` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:09.993444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] RBAC: Authorizing `identity:get_project(project_id=fff777f39d5941018014cff100fff5ca)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:09.995128 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:09.997022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 204/413] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:09 2022] GET /identity/v3/projects/fff777f39d5941018014cff100fff5ca => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:10.004615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:10.072389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:10.118610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:10.146171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5bf1-ae54-4552-9643-9a1401fbb445 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:10.150784 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dcd9b-946e-4ca9-8337-eafbd04ff630 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:10.182237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a2b88-fd34-4717-a175-b8ce701e5973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:10.184936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2b88-fd34-4717-a175-b8ce701e5973 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:10.185216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2b88-fd34-4717-a175-b8ce701e5973 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:10.185486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2b88-fd34-4717-a175-b8ce701e5973 None admin] PATH_INFO: `/v3/projects/fff777f39d5941018014cff100fff5ca/groups/1bf56589bb9848a6903f3d0d1c7611a9/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:10.187704 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a2b88-fd34-4717-a175-b8ce701e5973 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff777f39d5941018014cff100fff5ca, group_id=1bf56589bb9848a6903f3d0d1c7611a9, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:10.189319 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a2b88-fd34-4717-a175-b8ce701e5973 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:10.195755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:10.196790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:10.196898 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:10.197280 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e/groups/04c1a651872f4ef684a81750da5c474a/roles/d8b807df19b642feae1864b059dea9cf` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:10.200191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] RBAC: Authorizing `identity:create_grant(project_id=436ab180354048eea2ec3859c35fb16e, group_id=04c1a651872f4ef684a81750da5c474a, role_id=d8b807df19b642feae1864b059dea9cf)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:10.201662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:10.205180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 205/414] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 27 20:33:10 2022] PUT /identity/v3/projects/fff777f39d5941018014cff100fff5ca/groups/1bf56589bb9848a6903f3d0d1c7611a9/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 20:33:10.206923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d79ba-8152-4e26-9745-b2d9d943baf5 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:10.207206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d79ba-8152-4e26-9745-b2d9d943baf5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:10.207568 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d79ba-8152-4e26-9745-b2d9d943baf5 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:10.208956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 206/415] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:10.218617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:10.218617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:10.218617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:10.228955 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 210/416] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 27 20:33:09 2022] PUT /identity/v3/projects/436ab180354048eea2ec3859c35fb16e/groups/04c1a651872f4ef684a81750da5c474a/roles/d8b807df19b642feae1864b059dea9cf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:10.236310 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:10.237614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:10.318326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 207/417] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:10.652621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:10.785750 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071f28-0223-43ab-b26f-1b1fdf3a8658 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:10.788190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:10.822857 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:10.823497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:10.823832 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:10.824105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:10.834536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:10.840277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:10.841185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:10.841971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 211/418] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:10.847737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:10.932465 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:10.963408 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b91493-b792-4e68-b1a9-688f9f429662 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:10.999333 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:10.999948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.000222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.000490 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.001161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:11.001460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:11.002948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebce5-e99e-4fd8-988a-1a0b3551d4a7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:11.011843 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 208/419] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:11.017672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:11.118407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb5e6-a492-428d-a3d6-1993f99cbe0e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:11.160566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:11.161183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.161461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.161724 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.196548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690951a-5eaf-45f3-aa8a-ead4e4536eaa None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.196850 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690951a-5eaf-45f3-aa8a-ead4e4536eaa None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.197096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690951a-5eaf-45f3-aa8a-ead4e4536eaa None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.198685 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 209/420] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:11.203851 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.204162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.204409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.211004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:11.223517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:11.224624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:11.284765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:11.288042 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:11.318592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 210/421] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:11.460738 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 212/422] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:11.466706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:11.538506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:11.577483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a84e8e-f6ff-48d7-a39f-11a043f7078b None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:11.612484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:11.613123 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.613397 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.613721 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.614916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:11.616367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:11.618342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 211/423] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:11 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:11.624078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:11.688618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:11.720146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:11.747059 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b4240-65b0-45f3-923d-4eb378d4e066 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:11.831577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:11.833756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.834255 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.835413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.837402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:11.839240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:11.843586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 213/424] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:11 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:11.851387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:11.912001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc1b81-bf96-4219-844a-d1c675a2bfa8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:11.966464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:11.968072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:11.968650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:11.969112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:11.981147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:11.986956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:11.987849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:11.988624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:11.991810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 212/425] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:11.991956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:11.997821 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:12.102049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9bde-3b57-4414-9e6d-4b6061c90e93 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:12.136679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:12.140409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb1a8a-ac86-4a46-b541-560b3426637a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:12.143626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:12.144412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.144842 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.145249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.146120 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=6db042a0872b4a3ea922675cac1ff64c) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:12.146615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:12.148279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21680452-b95c-410b-931c-7b3511c022ac None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:12.155672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 214/426] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:11 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=ea04e85c0aa7408095b855be56c86503 => generated 611 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:12.157223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761926-785e-4ab0-8fa9-514fdf517a41 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.157675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761926-785e-4ab0-8fa9-514fdf517a41 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.158085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761926-785e-4ab0-8fa9-514fdf517a41 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.160027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 215/427] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:12.166123 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.166624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.166902 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.190308 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:12.191599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:12.192375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:12.193404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.194194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.195800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.196726 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:12.197206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:12.198971 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:12.211238 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 213/428] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:12.217668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:12.276463 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 216/429] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:12.301874 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:12.357695 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899194e-0dbe-4606-8b1f-a56280e4a5c4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:12.400459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:12.401351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.401768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.402175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.483531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:12.485056 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:12.546197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:12.599650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 214/430] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:33:12.605328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:12.677969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:12.730766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5e5d9-6918-454b-ae19-ad5e24a63947 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:12.765586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:12.778930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:12.780139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.781100 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.781571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] PATH_INFO: `/v3/projects/6db042a0872b4a3ea922675cac1ff64c` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.783224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] RBAC: Authorizing `identity:get_project(project_id=6db042a0872b4a3ea922675cac1ff64c)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:12.785482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:12.788199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 217/431] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:12 2022] GET /identity/v3/projects/6db042a0872b4a3ea922675cac1ff64c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:12.794020 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:12.811995 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f8a9-04cd-4b86-b424-2fb1191e8bd4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:12.855693 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15640fc-bf3d-400b-b829-a0afdaa8d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:12.856335 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15640fc-bf3d-400b-b829-a0afdaa8d148 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.856610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15640fc-bf3d-400b-b829-a0afdaa8d148 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.856876 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15640fc-bf3d-400b-b829-a0afdaa8d148 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.873790 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15640fc-bf3d-400b-b829-a0afdaa8d148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-c15640fc-bf3d-400b-b829-a0afdaa8d148 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:12.879460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:12.880385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:12.881194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 215/432] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:12.881975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680a7c-9780-4722-8608-c4099ca61039 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.882243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680a7c-9780-4722-8608-c4099ca61039 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.882543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3680a7c-9780-4722-8608-c4099ca61039 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.893891 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 216/433] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:12.893891 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680a7c-9780-4722-8608-c4099ca61039 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:12.913469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:12.924472 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fb875-f4d0-4751-99c7-6ddfde46ec2d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:12.969765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01949eb7-ca6f-46b5-a023-8d7a90ae9455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:12.970491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01949eb7-ca6f-46b5-a023-8d7a90ae9455 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.970794 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01949eb7-ca6f-46b5-a023-8d7a90ae9455 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.971096 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01949eb7-ca6f-46b5-a023-8d7a90ae9455 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.972277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01949eb7-ca6f-46b5-a023-8d7a90ae9455 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:12.973765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01949eb7-ca6f-46b5-a023-8d7a90ae9455 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:12.975706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 218/434] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:12 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:12.976974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:12.977257 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:12.977529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:12.996871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:12.998138 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:13.018297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3680a7c-9780-4722-8608-c4099ca61039 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.053950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.054647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.054925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.055195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.055851 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:13.056154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.057542 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.059460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.066335 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 217/435] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:33:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:13.067337 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.076371 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 219/436] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:13.077760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.152321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.183209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ca77-749e-4df8-af63-24e96518d9c9 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.213242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2212be-0bd1-4535-9b7f-9be5aac2466a None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.227647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.228905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.229565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.230158 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.231594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=6db042a0872b4a3ea922675cac1ff64c) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:13.232338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.234918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45f96-cf9e-4c15-8016-a07966c85193 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.249610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 218/437] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=6db042a0872b4a3ea922675cac1ff64c&role.id=d8b807df19b642feae1864b059dea9cf => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:13.251688 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.252310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.252635 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.252906 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.322011 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.333242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.334766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.334898 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9271fc-4f18-47d1-bcc6-0bf5a669b547 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.335113 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9271fc-4f18-47d1-bcc6-0bf5a669b547 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.335424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9271fc-4f18-47d1-bcc6-0bf5a669b547 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.338518 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 219/438] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:13.343367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.343766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.344042 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.363892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:13.365094 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:13.441990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 220/439] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:13.443225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.453780 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 220/440] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:13.460259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.530366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.568173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41feb2-8739-45fe-8f35-602b3d8f25dd None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.581596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.593540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242aec-5486-4c4d-8adf-d0a0fde1ea9a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.608443 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.609097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.609372 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.609638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.622350 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:13.627394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:13.628237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:13.629037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 221/441] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:13.634726 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.642366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.643132 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.643507 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.643876 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.645197 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.646718 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.648762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 221/442] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:13.654080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.768582 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9b87-bb25-430a-b277-462a25542790 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.769377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8e10-2c46-4d5f-93bc-232d90d2dbf3 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.799486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.804888 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.805528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.805810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.805940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.806079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.806506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.806783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.807048 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.807217 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.807710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] RBAC: Adding query filter params (name=admin) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:13.808004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.808675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.809376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.810245 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 222/443] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:13.811036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.822587 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 222/444] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:13.823256 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.839023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:13.908706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa594b-06cd-48c4-bdb8-05abfe4b22d8 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.922611 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0702c4-b265-499a-bdd5-9afba923943f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:13.941465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.942087 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.942356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.942652 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.952364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:13.954560 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:13.955164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:13.955442 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:13.955712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:13.956434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=ea04e85c0aa7408095b855be56c86503, scope.project.id=436ab180354048eea2ec3859c35fb16e) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:13.956738 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:13.957186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:13.958211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 20:33:13.959584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:13.960197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:13.960304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 223/445] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:13.960304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:13.974501 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 223/446] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=ea04e85c0aa7408095b855be56c86503 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:13.974501 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.032593 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.062809 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.079611 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356b2cf-5844-4d0a-a2e9-c963a035b873 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.082485 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ffc3d-9fb3-4a2d-9163-6f530adb7325 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.117604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.118540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.118856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.119123 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.119508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.120124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.120402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.120674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.121423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:14.121731 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.123202 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.132285 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 224/447] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:14.138137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.204740 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.206208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.263251 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806e7d-290a-4e99-8398-2ed4c9b31f85 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.282110 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.304934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.305553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.305831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.306105 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.306400 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.322510 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 224/448] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:14.328386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.378927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.380332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.431098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6075f04-207e-4dd8-9341-cc5fbaa8461f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.464137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.465080 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.465352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.465618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] PATH_INFO: `/v3/projects/fff777f39d5941018014cff100fff5ca` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.466792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] RBAC: Authorizing `identity:get_project(project_id=fff777f39d5941018014cff100fff5ca)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.468209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.469836 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 225/449] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/projects/fff777f39d5941018014cff100fff5ca => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:14.475370 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.482483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 225/450] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 20:33:14.484616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.502121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.529715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.573181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862475c-84f4-48ef-becc-d1b18daf102c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.581468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592429-49e5-4171-b7c2-928fa2f4c530 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.606754 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.607372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.607640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.607904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] PATH_INFO: `/v3/groups/1bf56589bb9848a6903f3d0d1c7611a9` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.608989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] RBAC: Authorizing `identity:get_group(group_id=1bf56589bb9848a6903f3d0d1c7611a9)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.610433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.611992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 226/451] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/groups/1bf56589bb9848a6903f3d0d1c7611a9 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:14.614650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.615279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.615612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.615885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] PATH_INFO: `/v3/projects/436ab180354048eea2ec3859c35fb16e` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.617053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] RBAC: Authorizing `identity:get_project(project_id=436ab180354048eea2ec3859c35fb16e)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.617955 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.618537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.624497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 226/452] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/projects/436ab180354048eea2ec3859c35fb16e => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:14.625430 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.706823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.718171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ca99b-552b-40aa-b751-d6a9b75c2df2 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.722640 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caf9d6-c092-4936-a190-937c281a46ef None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.741211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:14.752182 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.752774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.753043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.753309 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.754028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] RBAC: Adding query filter params (group.id=1bf56589bb9848a6903f3d0d1c7611a9, role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=fff777f39d5941018014cff100fff5ca) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:14.754325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.755802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7edbc-4caa-49af-a253-ce5bae9696b3 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.755913 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.756450 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.756722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.756994 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] PATH_INFO: `/v3/groups/04c1a651872f4ef684a81750da5c474a` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.758166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] RBAC: Authorizing `identity:get_group(group_id=04c1a651872f4ef684a81750da5c474a)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.759610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.761147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 227/453] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/groups/04c1a651872f4ef684a81750da5c474a => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:14.761388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 227/454] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/role_assignments?group.id=1bf56589bb9848a6903f3d0d1c7611a9&scope.project.id=fff777f39d5941018014cff100fff5ca&role.id=0f13813da5a84a44829df58f1d837465 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:14.767502 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:14.883138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb7e71-3f3a-47b2-9482-a40b94e5def8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:14.922764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:14.923461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:14.923638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:14.923905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:14.924638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] RBAC: Adding query filter params (group.id=04c1a651872f4ef684a81750da5c474a, role.id=d8b807df19b642feae1864b059dea9cf, scope.project.id=436ab180354048eea2ec3859c35fb16e) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:14.924941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:14.926393 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dece6-cdfc-43db-a434-015cc3c948b5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:14.932794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 228/455] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 27 20:33:14 2022] GET /identity/v3/role_assignments?group.id=04c1a651872f4ef684a81750da5c474a&scope.project.id=436ab180354048eea2ec3859c35fb16e&role.id=d8b807df19b642feae1864b059dea9cf => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:17.558489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8077b-dd39-47e3-9035-de3c23829de7 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:17.559558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8077b-dd39-47e3-9035-de3c23829de7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:17.560064 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8077b-dd39-47e3-9035-de3c23829de7 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:17.562036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 228/456] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:17.568294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b9af-4747-4fa3-82c9-0366441241a2 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:17.569232 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b9af-4747-4fa3-82c9-0366441241a2 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:17.569774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b9af-4747-4fa3-82c9-0366441241a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:17.588557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-7b72b9af-4747-4fa3-82c9-0366441241a2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:17.590387 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-7b72b9af-4747-4fa3-82c9-0366441241a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:17.604691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:17.660969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:17.717916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2537b-439a-466c-89a4-90924e73a7c5 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:17.718605 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2537b-439a-466c-89a4-90924e73a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:17.719075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2537b-439a-466c-89a4-90924e73a7c5 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:17.721034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 229/458] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:17.727361 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbb9f-2099-4c10-b36d-929cbef75b09 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:17.727974 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbb9f-2099-4c10-b36d-929cbef75b09 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:17.728486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bbb9f-2099-4c10-b36d-929cbef75b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:17.747884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-3d0bbb9f-2099-4c10-b36d-929cbef75b09 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:17.749427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-3d0bbb9f-2099-4c10-b36d-929cbef75b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:17.822627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 230/459] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:17.876566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2c52-59f7-4624-bb07-5e067a44e2b8 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:17.877217 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2c52-59f7-4624-bb07-5e067a44e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:17.877679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2c52-59f7-4624-bb07-5e067a44e2b8 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:17.879498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 230/460] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:17.886883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:17.886883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:17.886883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:17.905626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:17.906847 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:17.975039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 231/461] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:17.988703 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2c52-59f7-4624-bb07-5e067a44e2b8 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.106679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2c52-59f7-4624-bb07-5e067a44e2b8 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.142636 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.143602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.144097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.144583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.156008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.157897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.164514 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:18.172909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:18.173835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:18.175119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:18.175119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:18.175119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:18.175119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 231/462] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:18.180189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.180952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:18.224409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:18.271839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfab50-561b-46a3-8c0d-771ecdb5b578 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.294877 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25e9d-0186-4368-a533-0b65c35c8da0 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.306561 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.307198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.307473 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.307765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.317958 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.319467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.328773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.329373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.329650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.329921 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.330600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:18.330902 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.332266 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-471fd5fd-3023-4d11-8c14-5672bc867978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:18.333783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:18.334765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:18.335720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:18.335720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:18.335720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:18.335720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 232/463] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:18.336402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649790d-0ad9-4abe-ae1f-2e55a2d7376a None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.336402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649790d-0ad9-4abe-ae1f-2e55a2d7376a None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.336620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649790d-0ad9-4abe-ae1f-2e55a2d7376a None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.342614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 233/464] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:18.342614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649790d-0ad9-4abe-ae1f-2e55a2d7376a None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.344267 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 232/465] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:18.345131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.405513 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:18.440829 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:18.443745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8426106-da95-4cfb-86f3-b3290a62c1d6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.447356 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649790d-0ad9-4abe-ae1f-2e55a2d7376a None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.477214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.477815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.478090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.478358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.479043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:18.479341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.480385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.480703 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f98ddc-fc49-4f87-b498-7fb9c26c582a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.481014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.481290 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.481563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.491822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 233/466] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:18.491973 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.493034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.493318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.493414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.493588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:18.510534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:18.514586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:18.515505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:18.515505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:18.515505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:18.515679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:18.515748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 234/467] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:18.515748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.515861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:18.577633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 234/468] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:18.578461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.619955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b554c-5225-43c9-aae5-8bb744a4db4e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.632667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:18.655098 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.655772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.655966 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.656243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.656900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.658339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.677657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:18.682779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 235/469] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:33:18 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:18.684047 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.688168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9206604-b643-4017-b456-d34f657f1bfe None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.731871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.732731 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.733072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.733405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.734150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.735826 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.772551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 235/470] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:33:18 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:18.823779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf11b-dfb6-4bd1-9f66-72a08c2ae65b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:18.868708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:18.869391 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:18.869674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:18.869942 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:18.870641 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:18.870939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:18.872436 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:18.887767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 236/471] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:18.897145 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.907926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:18.942002 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:19.025544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309876-1c3f-4d35-a424-da2331ca5a8f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:19.039675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0330d79-fb75-48ce-adbe-60331f654791 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:19.067961 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:19.068569 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:19.068841 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:19.069102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:19.069789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:19.071294 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:19.086290 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:19.086985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:19.087322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:19.087591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:19.095986 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 236/472] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:33:18 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:19.101191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:19.102755 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:19.119858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:19.120815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:19.121674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:19.121674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:19.121674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:19.121674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 237/473] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:19.128928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:19.132252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:19.253204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c339ba-dd89-4b4d-9422-a149c7d118eb None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:19.291948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:19.292582 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:19.292861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:19.293129 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:19.293786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:19.294088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:19.295496 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b8cf9-52d5-49cb-9682-41633fed23cd None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:19.308325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 237/474] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:19.313798 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:19.399600 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:19.424209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdbccb-90d7-4d5f-b232-b3b40fdc0ffc None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:19.462582 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81886-8e4f-4a5b-b6bd-7ab6301234d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:19.463192 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81886-8e4f-4a5b-b6bd-7ab6301234d2 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:19.463470 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81886-8e4f-4a5b-b6bd-7ab6301234d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:19.463740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81886-8e4f-4a5b-b6bd-7ab6301234d2 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:19.464403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff81886-8e4f-4a5b-b6bd-7ab6301234d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:19.466162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff81886-8e4f-4a5b-b6bd-7ab6301234d2 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:19.488734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 238/475] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:33:19 2022] POST /identity/v3/users => generated 249 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:21.062292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cffec-1787-424d-b078-ac3f498f2212 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.063269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cffec-1787-424d-b078-ac3f498f2212 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.063685 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cffec-1787-424d-b078-ac3f498f2212 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.065461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 238/476] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:21.071251 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41345-9623-4c91-a506-242cda7f9a2f None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.072058 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41345-9623-4c91-a506-242cda7f9a2f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.072552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41345-9623-4c91-a506-242cda7f9a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.091671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-dcc41345-9623-4c91-a506-242cda7f9a2f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:21.093195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-dcc41345-9623-4c91-a506-242cda7f9a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:21.156861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a5f2-d5df-401b-808e-f87f045012b1 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.157053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a5f2-d5df-401b-808e-f87f045012b1 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.157297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a5f2-d5df-401b-808e-f87f045012b1 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.159000 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 239/477] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:21.164147 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337580de-9c02-46aa-bab5-c6714b4942da None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.164447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337580de-9c02-46aa-bab5-c6714b4942da None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.164721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337580de-9c02-46aa-bab5-c6714b4942da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.167579 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 239/478] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:21.183766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-337580de-9c02-46aa-bab5-c6714b4942da None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:21.184942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-337580de-9c02-46aa-bab5-c6714b4942da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:21.244007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:21.256693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 240/479] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:21.404024 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349299f-ebcd-4850-904f-15874d9a7dcb None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.404360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349299f-ebcd-4850-904f-15874d9a7dcb None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.404555 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349299f-ebcd-4850-904f-15874d9a7dcb None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.405892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 240/480] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:21.411319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.411532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.411816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.430738 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:21.431910 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:21.503940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 241/481] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:21.511165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349299f-ebcd-4850-904f-15874d9a7dcb None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:21.585641 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:21.592640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:21.630146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349299f-ebcd-4850-904f-15874d9a7dcb None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:21.674154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:21.675199 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.675478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.675746 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.691871 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:21.697367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d89b39-23fb-4eca-8fbf-7c60842e63d1 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:21.699072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:21.699976 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:21.700767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:21.708758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 241/482] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:21.711459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:21.725266 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:21.738224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22086f04-39aa-4d43-b24f-820cdaa3df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:21.739152 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086f04-39aa-4d43-b24f-820cdaa3df24 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.739528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086f04-39aa-4d43-b24f-820cdaa3df24 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.739893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22086f04-39aa-4d43-b24f-820cdaa3df24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.750936 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22086f04-39aa-4d43-b24f-820cdaa3df24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-22086f04-39aa-4d43-b24f-820cdaa3df24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:21.755890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:21.757134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:21.758659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:21.760071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 242/483] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:21.764629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a93cce-7c80-42f8-a2da-a41f40b7dc13 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.765277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a93cce-7c80-42f8-a2da-a41f40b7dc13 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.765793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a93cce-7c80-42f8-a2da-a41f40b7dc13 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.771942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 243/484] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:21.771942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a93cce-7c80-42f8-a2da-a41f40b7dc13 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:21.825773 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebbfe-0ac3-4548-9a4b-c9baccd00051 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:21.851964 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:21.861081 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:21.861668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.861936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.862196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.862890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:21.863180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:21.864553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf54215-dc38-4009-8125-0d2c2abbe128 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:21.872354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 242/485] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:21.877193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a93cce-7c80-42f8-a2da-a41f40b7dc13 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:21.877295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.877295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.877295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.893491 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:21.894720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:21.913333 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:21.914083 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:21.914354 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:21.914649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:21.915317 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] RBAC: Adding query filter params (name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:21.915605 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:21.916975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:21.925029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 244/486] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:21.925726 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:21.961670 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 243/487] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:21.963248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:21.973167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.029757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10badc-05d9-4158-b07a-99be1fedfd68 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.063444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.064145 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.064426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.064695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.072663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1430f70-348b-4fb2-9566-d17cd448df8d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.074329 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:22.079518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.080403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:22.081191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 245/488] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.081820 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.097108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.116380 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.117009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.117280 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.117542 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.129425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.130914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:22.145453 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.146433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:22.147411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:22.147411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:22.147411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:22.147411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 244/489] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.147645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.190147 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae8ac9-b75e-4d9a-b0cd-d6d871b4781b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.193402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.227645 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.228279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.228821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.228821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.239651 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.241023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.255141 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d85c-dc6d-4f0b-8061-d2dc0d32c10a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:22.255675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.256511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:22.257393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:22.257393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:22.257393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:22.259090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 246/490] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.260054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.292287 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.292889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.293419 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.294083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:22.294378 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.295782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.303868 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 245/491] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:22.304641 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.335432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.363160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bf064-1556-48bd-be22-33243a07c498 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.395366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.395962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.396239 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.396507 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.397156 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:22.397486 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.398906 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.400818 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e6af-5e82-48a9-bac9-8ccc08278096 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.411804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 247/492] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:22.412633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.431451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.434790 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.435376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.435709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.435977 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.436613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:22.436921 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.438287 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.449681 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 246/493] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:22.450474 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.519988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2c6b-cee7-4525-8688-d5f5e5ca5fbc None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.540161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.550218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f119d1-c475-46f4-8bb5-321e9951bca7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.554008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.554649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.554916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.555177 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.565179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:22.569937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.571057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 248/494] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.572344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.587521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.588181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.588455 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.588813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.599154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.600628 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:22.615195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:22.617091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:22.617091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:22.617091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:22.617091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 247/495] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.617298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.652770 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.675157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7fa7-0f45-44a6-84f5-82a5b2597136 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.708306 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.708847 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.709095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.709379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.713740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a621-41ca-43cd-bd1f-d56ef219bece None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.717897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.719388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:22.732065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.732999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 249/496] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.733946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.752395 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.753022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.753297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.753566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.761118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.762616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:22.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:22.776415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 248/497] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:22.777304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.780830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.843038 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9098ddf-0e1a-445a-beb6-5227576ac834 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.876606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.877203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.877478 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.877741 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.878399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] RBAC: Adding query filter params (name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:22.878721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.878811 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a20159-8836-41cf-ae2f-46a1204a6225 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.880105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.882279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:22.889966 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 250/498] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:22.890775 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.919145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:22.919769 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:22.920039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:22.920302 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:22.920975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:22.921268 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:22.922682 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:22.934359 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 249/499] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:22.935161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:22.988588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e583400-f498-404a-a116-e68dc2a68e50 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:22.996656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.022627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.023251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.023527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.023792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.024491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:23.024785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.026225 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.033877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26a186-4d2b-4d5c-9557-80696ca303ab None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.062220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 251/500] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:23.063127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.072979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.073584 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.073871 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.074120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.074883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:23.075181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.076613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.112710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 250/501] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 27 20:33:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:23.113528 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.117876 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.162480 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5abb8-9a7b-48fb-9eae-56ae7d64137c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.195661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.196285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.196599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.196861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.206859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.208332 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.212988 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34de7ab-8dd1-4fb1-8110-35d5f243314a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:23.224135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:23.225062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:23.225950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:23.225950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:23.225950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:23.225950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 252/502] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:23.226156 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.239602 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.252657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.253283 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.253551 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.253851 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.260884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.262344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:23.273808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:23.274782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 251/503] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:23.275684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.325044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046691fd-e67e-4c08-bd2d-61eeea5d5cf6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.333602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.359402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.360023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.360291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.360557 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.376442 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326907d-a28d-4cec-8443-dc70a645d4bb None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.412731 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.413351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.413625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.413892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.427609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.429136 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.465653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.485605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.487125 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.525248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 253/504] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:23.526048 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.535762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.591558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 252/505] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:23.591558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.624872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091ffcd-58a3-4d35-875a-0a67b4a6c99a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.660576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.661489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.661803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.662077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.662780 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:23.663131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.664507 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.674847 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.676253 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 254/506] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:23.677202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.694260 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e21f-5242-42e5-85e1-f28817d885a4 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.728036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.728624 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.728901 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.729169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.729892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:23.730191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.731686 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.741162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.749083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 253/507] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:23.749875 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.776078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61bdab-2fe5-4b89-ab86-77a2437419b5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.810533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.811164 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.811439 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.811706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.822081 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.823596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:23.837585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:23.838430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:23.839771 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:23.839771 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:23.839771 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:23.839771 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 255/508] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:23.841292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.854853 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfb54f-92a7-4ec0-bce4-3832d5d58851 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.890221 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.890883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.891151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.891412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.900300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.902638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.904189 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:23.919039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:23.919951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:23.920775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:23.920775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:23.920775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:23.920775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 254/509] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:23.920993 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:23.945126 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5346fc-7539-4696-82af-17ea1f0d6fd4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:23.964286 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:23.978635 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:23.979262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:23.979536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:23.979801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:23.987194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:23.988657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:23.999503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:24.000603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 256/510] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:24.001606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.028945 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faaebdd-1dde-4a97-8f07-10779447ee61 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.061841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.062468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.062758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.063048 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.095983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aec1c-5e33-4a3c-8f9e-13ab004098d6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.120969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.129937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.130571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.130844 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.131109 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.131203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.131778 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:24.132071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.132640 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.133423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.145120 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 257/511] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:24.145917 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.188746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.235072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 255/512] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:24.235910 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.253335 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90105b-160f-4d0f-8dcd-b03b99b9bdad None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.287209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.287767 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.288041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.288310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.288949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:24.289244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.290640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.301580 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 258/513] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:24.302180 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.329851 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.339822 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a7d4a-8b51-4863-9963-b0abfe20911a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.372561 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.373150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.373420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.373702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.374425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:24.374757 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.376211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.393008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 256/514] 10.222.0.15 () {56 vars in 1139 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:24.393626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.406407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.409526 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e471e6-3c9f-4af5-9940-8c78a1c37048 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.443953 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.444617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.444900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.445181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.452654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.454121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:24.466202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:24.467079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:24.467893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 259/515] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:24.468347 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.505304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726f03-05fb-4869-9b1b-60ee49b373de None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.539012 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.539674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.539948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.540214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.550098 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.551599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:24.566713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:24.567603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:24.568448 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:24.568448 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:24.568448 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:24.568610 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055f23-31f5-4a13-8ad8-6959f9784199 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.568689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 257/516] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:24.569030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.574606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.603062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.603695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.603972 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.604244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.610870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.612315 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:24.624614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:24.625579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 260/517] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:24.626426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.648584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.676346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ca9e-3c5a-452a-92ce-1b2d93d623f0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.709449 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.710073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.710349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.710672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.727059 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5318b-c69b-423d-a40d-71f09e40880a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.760351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.760946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.761228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.761501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.762195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:24.762535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.763991 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.777240 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.778872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.780961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.781594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 261/518] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:24.782437 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.876155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:24.896915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cce8d-aee2-4405-b4c9-113d65bbb2df None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.898817 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 258/519] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:24.902619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.932820 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:24.933456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:24.933734 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:24.934007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:24.934698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:24.935020 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:24.936395 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:24.947581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 262/520] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:24.948465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:24.998511 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0618f-90d7-41bf-ba7b-d47fca214766 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:24.999975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.032310 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.032907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.033204 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.033451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.034146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.034468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.035906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.045023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec41ec3-7964-4a45-87cc-bab5da8fd6f3 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.053068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 259/521] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.053885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.078752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.079337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.079630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.079899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.080613 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=b0822ef274eb4139ae825a9a4ef282ab) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.080918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.082362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.087735 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 263/522] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:24 2022] GET /identity/v3/role_assignments?user.id=b0822ef274eb4139ae825a9a4ef282ab&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.088576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.093098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.165825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b322ebc-3a35-4f49-996b-d4cf82bcd2bf None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.201964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb2c6-7b45-4575-acfe-122db2090f36 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.203041 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.203682 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.203954 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.204223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.217239 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.218759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:25.236070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:25.237165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:25.238027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:25.238027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:25.238027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:25.238027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 260/523] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:25.238438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.245607 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.246276 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.246604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.246875 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.254538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.256158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.260261 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:25.270027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:25.270963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 264/524] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:25.271924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.342735 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.356599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d245-e4c6-49d7-b322-a709a0089464 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.381275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af2c3-3b04-4bcf-b168-dc1a7416a17c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.392237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.392844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.393119 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.393386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.394225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=01102d0faa3845e0a76afc772579e808) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.394558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.396143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.410907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 261/525] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/role_assignments?user.id=01102d0faa3845e0a76afc772579e808&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.411701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.420339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.420897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.421172 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.421438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.422115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.422417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.423896 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.447031 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 265/526] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.448680 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.520044 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.546097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542a567-5167-4a15-8b16-3ca6f344ffe6 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.584057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.584403 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e9c84-e140-4290-b743-f66a9e852c62 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.585288 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.585782 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.586385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.587428 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.587930 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.590141 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.609071 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 262/527] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.610366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.613974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.626900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.627649 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.628446 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.628777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.637313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.639553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:25.654130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:25.655170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:25.656027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 266/528] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:25.662312 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.733693 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea85df-998f-4785-9a8d-f7587fd23a2e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.781116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.782322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.782868 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.783338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.784245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=ed5cc105367448a59da0ce5cfe60e175) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.784729 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.786328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363fa19-6aab-4786-aad9-f06ee1baefb8 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:25.787413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.803709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 263/529] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/role_assignments?user.id=ed5cc105367448a59da0ce5cfe60e175&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.828407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:25.829044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:25.829325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:25.829597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:25.830314 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:25.830667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:25.832223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6af07-b984-42db-8380-2eacebbac74f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:25.847429 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 267/530] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:25.853108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:25.862821 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:25.973175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6765992-4be0-4478-ba49-87f7094bc092 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:26.009960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:26.011295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:26.011295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:26.011295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:26.011949 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=df9d9d38efd14328b4d6230278a49fae) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:26.012255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:26.013718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84258d-a02a-4bb1-901d-8fb97cdb3426 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:26.022502 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 264/531] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:25 2022] GET /identity/v3/role_assignments?user.id=df9d9d38efd14328b4d6230278a49fae&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:27.287284 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaad1c-3af6-4cad-b4b0-c2b0b03c7c6e None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:27.287870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaad1c-3af6-4cad-b4b0-c2b0b03c7c6e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:27.287870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaad1c-3af6-4cad-b4b0-c2b0b03c7c6e None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:27.289538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 268/532] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:27.295670 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7c2c-f2be-4c9b-b90b-256a10a2d8f3 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:27.296087 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7c2c-f2be-4c9b-b90b-256a10a2d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:27.296273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7c2c-f2be-4c9b-b90b-256a10a2d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:27.314688 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-cf0e7c2c-f2be-4c9b-b90b-256a10a2d8f3 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:27.315864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-cf0e7c2c-f2be-4c9b-b90b-256a10a2d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:27.377950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:27.386827 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 265/533] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:27.656401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c74f9-08df-4ecb-9304-420dc0646a95 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:27.656752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c74f9-08df-4ecb-9304-420dc0646a95 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:27.656852 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c74f9-08df-4ecb-9304-420dc0646a95 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:27.658474 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 269/534] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:27.663754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:27.664036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:27.664307 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:27.682743 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:27.683924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:27.733156 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c74f9-08df-4ecb-9304-420dc0646a95 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:27.759189 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 266/535] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:27.785148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:27.842470 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c74f9-08df-4ecb-9304-420dc0646a95 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:27.884342 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7966a-98ca-4ac6-b8eb-892dc2f8eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:27.884996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7966a-98ca-4ac6-b8eb-892dc2f8eb25 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:27.885266 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7966a-98ca-4ac6-b8eb-892dc2f8eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:27.886494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7966a-98ca-4ac6-b8eb-892dc2f8eb25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:27.899092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7966a-98ca-4ac6-b8eb-892dc2f8eb25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-2af7966a-98ca-4ac6-b8eb-892dc2f8eb25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:27.904583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:27.905554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:27.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:27.910582 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 270/536] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:27.912380 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.014135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c4d77-7d5f-49ca-b01c-d884de8e1223 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.050232 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.059716 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8813a-3f66-4982-a786-ca9b4b03e692 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.060032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8813a-3f66-4982-a786-ca9b4b03e692 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.060269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8813a-3f66-4982-a786-ca9b4b03e692 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.061053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.061668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.061943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.062210 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.062545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 271/537] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:28.062921 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:28.063221 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.064646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.068276 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.068558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.068819 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.075006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 267/538] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:28.081529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.088800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:28.090336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:28.164883 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 272/539] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:28.165733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.195504 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d1481-6cdc-4b13-bd69-51ba54d9d768 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.207964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.235648 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.236623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.237095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.237672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.249106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.251000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-71a6151d-ed22-4e28-8ca1-8e46862b28cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:28.265842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:28.266815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 268/540] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb829d-5844-490b-96e3-fdb064a24709 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb829d-5844-490b-96e3-fdb064a24709 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb829d-5844-490b-96e3-fdb064a24709 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.272224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 269/541] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:28.273947 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb829d-5844-490b-96e3-fdb064a24709 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.286629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c952-b986-4504-afdc-ad69997e2314 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.317057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.325002 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f115c2-261c-4150-be9b-99c3081300c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.325746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f115c2-261c-4150-be9b-99c3081300c3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.326022 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f115c2-261c-4150-be9b-99c3081300c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.326286 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f115c2-261c-4150-be9b-99c3081300c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.339129 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f115c2-261c-4150-be9b-99c3081300c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-03f115c2-261c-4150-be9b-99c3081300c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:28.344521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:28.345396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:28.346199 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 273/542] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:28.347363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.347363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.347363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.365645 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:28.366990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:28.381506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb829d-5844-490b-96e3-fdb064a24709 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.416142 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.416670 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.416944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.417203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.417839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:28.418136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.419531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.431030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 270/543] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:28.431825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.440517 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 274/544] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:28.441593 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.474839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.536068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.539710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b97f70-91b4-4ef7-8dc5-c151a8077cf7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.555610 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c36c1-962c-49af-a08b-436a9281d03d None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.575106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.575710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.575984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.576248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.576940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:28.577236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.578650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.591700 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 271/545] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:28.591700 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.596368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.597003 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.597275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.597539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.605286 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.606776 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:28.617816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:28.618759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:28.619614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 275/546] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:28.620748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.698862 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dae376-4b37-485c-87f3-0567fe08d6fd None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.702022 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.719435 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5266cb-2bdb-42ea-8bfe-0a91045947c8 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.739192 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.740118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.740370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.740636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] PATH_INFO: `/v3/roles/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.752316 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:28.752530 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.753085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.753438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.753704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:28.757574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:28.758500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:28.763253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.767648 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.769090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:28.783234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:28.784326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:28.785176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:28.785176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:28.785176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:28.785176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 276/548] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:28.785176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.789367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.863959 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026b63-c654-49b6-9e3f-a4ffcbc60caa None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.885044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e2f1f-2c01-4a88-80d4-7fd3b014702a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:28.900476 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.901084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.901388 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.901657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.902386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:28.902730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.904220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.921640 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:28.922360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:28.927763 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:28.928427 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:28.928702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:28.928971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:28.929632 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] RBAC: Adding query filter params (name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:28.929925 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:28.931319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:28.933707 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:28.940167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 277/550] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:28.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.000495 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.019673 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40658ca6-dee5-4239-b7b8-0923973d655c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.041224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b690-f974-42de-b2b0-45d0b5c96932 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.053328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.053951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.054220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.054515 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.064559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:29.069484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.070567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:29.071425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 274/551] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.072692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.078682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.079297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.079567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.079831 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.080470 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:29.080767 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.082130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.094918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 278/552] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:29.095735 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.151599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.175854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd8e18-b61b-4082-bef3-3c0faf23f3c5 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.195041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbc1ce-c945-4af4-94e9-3d76e2152751 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.216236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.216857 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.217136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.217393 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.226108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.228291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.229990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.230143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.230714 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.230997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.231264 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.242131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.243599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:29.244594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.245524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:29.246367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:29.246367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:29.246367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:29.246367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 275/553] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.246737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:29.263860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.264992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:29.265839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:29.265839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:29.265839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:29.265839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 279/554] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.265839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.349203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e9ff1-435b-4552-8d7f-e3fcc27a7253 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.365468 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3a6b-30ce-4111-a2be-d6f9cef14301 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.376176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.384639 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.385236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.385506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.385768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.386415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:29.386737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.388106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.395958 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 276/555] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:29.396728 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.399909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.400538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.400817 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.401084 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] PATH_INFO: `/v3/users/glance` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.409102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.410588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:29.421642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.422626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 20:33:29.423540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:29.426782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 280/556] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.427651 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.453416 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.496067 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3fdc6-17e2-4242-b567-9a83fe14c699 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.526327 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254ccd1-7b79-4bff-b297-1293e96f488b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.528557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.529156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.529435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.529700 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.530338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:29.530673 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.532064 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.543522 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 277/557] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:29.544318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.558352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.558989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.559282 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.559531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.560203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:29.560498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.561867 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.573946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 281/558] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:29.574816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.605130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.643323 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740fcd-181b-4b7a-b504-89b26eaf501e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.657802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.673835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36977a-afb0-4d67-84bb-427e38a56f96 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.679342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.679980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.680257 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.680527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.690346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.691839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:29.706255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.707184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:29.708321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:29.708321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:29.708321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:29.708717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.708717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.708717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.708923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 278/559] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.708989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.709053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.709126 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:29.709126 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.710189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.728126 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 282/560] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:29.728941 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.810948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fc221-3881-44d6-91d4-02d32cb8c074 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.816368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.828918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa6e37-ebdd-4330-b0ce-a094dbb137d2 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.845619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.846243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.846546 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.846814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.853329 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.855060 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.862226 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:29.862885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:29.863164 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:29.863434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:29.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.867300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:29.868186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 279/561] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.868677 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.870518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:29.871957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:29.883508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:29.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:29.885535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 283/562] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:29.886133 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:29.901873 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:29.972935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d917df-01c9-4c29-bbeb-26701c81b07e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:29.989791 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89515c-5369-456d-a97f-7b7d7eaf8767 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.007019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.007615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.007888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.008149 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.008783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:30.009082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.010474 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.022805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 280/563] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:30.022938 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.023541 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.023659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.023829 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.024088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.039201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.041073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.049043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:30.056300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:30.057455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:30.058423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:30.058423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:30.058423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:30.062406 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 284/564] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:30.063246 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.113934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.129122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86704fd8-ae87-4033-8426-3946dc307b0b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.161036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105a73e-f534-4128-a678-ae9649287848 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.163698 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.164304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.164578 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.164844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.165532 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:30.165829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.167316 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.178639 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 281/565] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:30.179604 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.198562 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.199168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.199447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.199721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.200450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:30.200758 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.202190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.220056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 285/566] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:30.220850 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.275424 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.281703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3438c0-b826-4ae6-90c3-c4987e420c95 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.316131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433ea7e-dd62-4ef1-85bd-c9590d20ad46 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.316297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.316729 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.317004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.317273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.324716 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.326152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:30.337170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:30.338263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 282/567] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:30.340043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.349943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.356645 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.357252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.357529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.357796 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.358472 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:30.358766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.360180 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.374639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 286/568] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:30.374639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.442147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6014fd-f82c-49cb-b677-63c2429745d8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.467692 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a2355-3a95-4b4e-aca8-bf5712935813 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.474826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.475551 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.475828 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.476100 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/b0822ef274eb4139ae825a9a4ef282ab/roles/aea049c3ffe34aa5852e29c85044a538` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.483887 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.490163 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=b0822ef274eb4139ae825a9a4ef282ab, role_id=aea049c3ffe34aa5852e29c85044a538)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.491671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.501121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.501721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.501996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.502269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.504162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 283/569] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:33:30 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/b0822ef274eb4139ae825a9a4ef282ab/roles/aea049c3ffe34aa5852e29c85044a538 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:30.504945 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.513477 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.515042 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:30.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:30.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:30.536434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:30.536434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:30.536434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:30.538814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 287/570] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:30.540062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.583267 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.631933 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6057c15-067f-4684-aced-49e15a94ec44 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.659601 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154da9-d527-44f6-99c9-5c0c15037f0f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.672346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.672961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.673233 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.673499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.674242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:30.674575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.676040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.697860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 284/571] 10.222.0.15 () {56 vars in 1139 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:30.699263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.704088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e47678-9879-4309-87bb-835d854581ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.704762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e47678-9879-4309-87bb-835d854581ac None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.705049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e47678-9879-4309-87bb-835d854581ac None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.705298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e47678-9879-4309-87bb-835d854581ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.712761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e47678-9879-4309-87bb-835d854581ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.714537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e47678-9879-4309-87bb-835d854581ac None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-66e47678-9879-4309-87bb-835d854581ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:30.726913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:30.727988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:30.728988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 288/572] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:30.733968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e47678-9879-4309-87bb-835d854581ac None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.768038 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.808831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0ea8b-6773-4b14-857c-948daace043f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.824344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:30.842532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e47678-9879-4309-87bb-835d854581ac None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:30.847479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.848091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.848367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.848637 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.849300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:30.849603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.851104 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.863493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 285/573] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:30.864327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.887112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:30.887112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:30.887112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:30.887112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:30.898212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:30.899750 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:30.914630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:30.915690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:30.916759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:30.916759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:30.916759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:30.916759 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 289/574] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:30.919673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:30.978281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11811816-cefd-42e2-bd63-8dc7dfa600f2 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.005864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:31.018166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.018888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.019269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.019588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.020418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:31.020794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.022383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.024717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7bf11-8f14-44fd-8144-aab34ae2d002 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.034791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 286/575] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:31.035608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.066204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.066872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.067151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.067424 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.074284 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.075886 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.076180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:31.090782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:31.091894 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:31.092959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:31.094656 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 290/576] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:31.095527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.161190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce9c5-8fc3-4707-9f85-48600eb0f60f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.197028 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.197727 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.198079 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.198425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.198687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0c7b6-3956-48fe-a92c-f083bcbd90e1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.199237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:31.199610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.201698 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.213037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 287/577] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:31.218464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.235162 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.235815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.236098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.236367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/01102d0faa3845e0a76afc772579e808/roles/aea049c3ffe34aa5852e29c85044a538` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.248810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:31.252848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=01102d0faa3845e0a76afc772579e808, role_id=aea049c3ffe34aa5852e29c85044a538)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.254670 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.268436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 291/578] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:33:31 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/01102d0faa3845e0a76afc772579e808/roles/aea049c3ffe34aa5852e29c85044a538 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:31.279566 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.338759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:31.347701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c2177-e2a5-4a84-b2e7-4fab4090047d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.390864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.391563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.391745 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.392014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.392718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:31.393017 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.396292 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.411578 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 288/579] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:31.417982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.441166 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3823a9-f4fa-4db3-abd3-b7fb60dd7c02 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.478888 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.479772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.480868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.481324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.488561 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.490067 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:31.501608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:31.502702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:31.503606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 292/580] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:31.508928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.543918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104036c-0b4d-49ec-bb08-1408ac95cc07 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.578639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:31.580121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.580788 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.581114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.581634 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/ed5cc105367448a59da0ce5cfe60e175/roles/aea049c3ffe34aa5852e29c85044a538` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.599412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=ed5cc105367448a59da0ce5cfe60e175, role_id=aea049c3ffe34aa5852e29c85044a538)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.600900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.619752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 289/581] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:33:31 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/ed5cc105367448a59da0ce5cfe60e175/roles/aea049c3ffe34aa5852e29c85044a538 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:31.638060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085dde-e207-454d-9da9-e05ec3c803b2 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.675953 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.676579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.676859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.677132 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.677851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:31.678219 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.679753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ca08-a9d3-448e-8c47-060855e73048 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.694182 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 293/582] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:31.700095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:31.704422 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:31.813771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530bf6-9939-4f93-994b-6802c3ac05b3 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:31.850970 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fb492-a669-405d-a414-40c9e7bd439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:31.851551 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb492-a669-405d-a414-40c9e7bd439a None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:31.851821 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb492-a669-405d-a414-40c9e7bd439a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:31.852092 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fb492-a669-405d-a414-40c9e7bd439a None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/df9d9d38efd14328b4d6230278a49fae/roles/aea049c3ffe34aa5852e29c85044a538` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:31.868916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fb492-a669-405d-a414-40c9e7bd439a None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=df9d9d38efd14328b4d6230278a49fae, role_id=aea049c3ffe34aa5852e29c85044a538)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:31.870653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fb492-a669-405d-a414-40c9e7bd439a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:31.899318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 290/583] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:33:31 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/df9d9d38efd14328b4d6230278a49fae/roles/aea049c3ffe34aa5852e29c85044a538 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:32.716849 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c565f6c-6fb0-4409-8ab5-362c1d2ff379 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:32.717419 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c565f6c-6fb0-4409-8ab5-362c1d2ff379 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:32.717663 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c565f6c-6fb0-4409-8ab5-362c1d2ff379 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:32.719415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 294/584] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:32.724744 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:32.725227 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:32.725529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:32.743743 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:32.744923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:32.797162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:32.819812 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 291/585] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:33.142423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c565f6c-6fb0-4409-8ab5-362c1d2ff379 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:33.246360 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c565f6c-6fb0-4409-8ab5-362c1d2ff379 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:33.259941 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:33.280999 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:33.281622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:33.281897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:33.282164 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:33.292691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:33.297549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:33.298525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:33.299379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 295/586] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:33.305019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:33.412608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec5a4f-8bd9-447a-9494-574041e7fb74 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:33.447810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:33.448474 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:33.448754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:33.449019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:33.449688 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:33.449986 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:33.451404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb0811-f147-45e9-93e7-73c94fa9b461 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:33.460406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 292/587] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:33.466471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:33.528264 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534bb2-d0ec-4960-be30-52ea56659139 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:33.528582 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534bb2-d0ec-4960-be30-52ea56659139 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:33.528862 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534bb2-d0ec-4960-be30-52ea56659139 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:33.530354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 293/588] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:33.536384 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:33.536929 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:33.537467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:33.559884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:33.561802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:33.573418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d3ad-d5c8-47be-b795-471ada092fe9 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:33.610434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:33.611240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:33.611614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:33.612006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:33.616478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:33.625597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:33.627319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:33.642559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:33.643710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:33.644574 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:33.644574 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:33.644574 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:33.648386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 294/589] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:33.648464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 296/590] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:33.653481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:33.861816 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81edda0-0c98-482f-9b0a-ffaeaef7decf None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:33.920416 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:33.921377 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:33.921829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:33.922264 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:33.923219 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:33.923701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:33.925349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74168239-3432-4b60-ae65-7b89d17529ed None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:33.939125 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 295/591] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:33.945220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:33.973895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.026219 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fbdf-7c6b-41d7-ac5f-2f3855fa0b3a None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.026885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fbdf-7c6b-41d7-ac5f-2f3855fa0b3a None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.027323 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fbdf-7c6b-41d7-ac5f-2f3855fa0b3a None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.029251 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 296/592] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:34.036094 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.036686 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.037137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.059844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:34.061852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:34.077844 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b1ad0-d450-4ede-b97b-2eee78bdc983 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.101078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.126234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.126968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.127246 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.127660 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.136235 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:34.137942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:34.150396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:34.151514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:34.152447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:34.155823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 297/593] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:34.156248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 27 20:33:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:34.157415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.157610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.250720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.271471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3582c5-ee03-46a0-8445-53e709720e72 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.273440 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8d828-624c-4aec-b00a-2a3c9e4893e9 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.316607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d0cbb-c741-44f7-9be1-771e80695dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.317248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d0cbb-c741-44f7-9be1-771e80695dfc None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.317523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d0cbb-c741-44f7-9be1-771e80695dfc None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.317787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d0cbb-c741-44f7-9be1-771e80695dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.320448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.321326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.321817 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.322283 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.323234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:34.323736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:34.325370 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:34.330213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d0cbb-c741-44f7-9be1-771e80695dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-663d0cbb-c741-44f7-9be1-771e80695dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:34.335719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:34.336650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:34.337472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 298/595] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:34.338706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594b9c-3110-47bc-8d88-5b59e85dc363 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.338706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594b9c-3110-47bc-8d88-5b59e85dc363 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.338881 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594b9c-3110-47bc-8d88-5b59e85dc363 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.345470 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 299/596] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:34.348898 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.349177 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.349444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.354524 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 298/597] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:34.355610 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.378918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:34.380034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:34.402792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.452677 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 300/598] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:34.453956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.483501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89fbbf-2394-44da-afb1-984153f5ed4b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.518952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.519555 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.519840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.520089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.520758 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:34.521050 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:34.522436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:34.535240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 299/599] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:34.535240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.539493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.565076 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b9d7f-4182-48e8-ba0c-d0594c452a9d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.603765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.604803 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.605422 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.605792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.642405 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.645001 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522368e9-06b4-4220-904c-9a208d4ca9e0 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.682006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.682814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.683091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.683834 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.685451 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:34.687348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:34.694052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:34.699410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:34.700514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 300/600] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:34.706358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.769308 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.797923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 301/601] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:34.797923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.809777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b032b4-10f2-4a2d-8a50-c7ef0d09ba25 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.844764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.845397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.845676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.845946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.848931 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:34.856696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:34.858149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:34.871892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:34.872804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:34.873676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:34.873676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:34.873676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:34.873676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 301/602] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:34.873983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.899376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78e83-0c86-4a12-b870-1935ca07282d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.933289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:34.933886 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:34.934157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:34.934421 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:34.935116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:34.935411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:34.936815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:34.944783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 302/603] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:34.945777 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:34.971054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bae7e-f94b-459c-b94a-f0f1d6a1cdb5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:34.987369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.005393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.006036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.006371 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.006773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.016831 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:35.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.023035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:35.023904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 302/604] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.024583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.052588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4b4b3-a944-4480-90b8-c962faab95c7 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.068943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.089411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.090138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.090414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.090719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.101061 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.102571 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:35.116540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.117703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:35.118878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:35.118878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:35.118878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:35.118878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 303/605] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.118878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.131620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818e926-c198-4314-8d5c-7fcdd6dc179f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.166406 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.166973 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.167252 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.167524 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.168172 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:35.168472 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.169850 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.181507 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 303/606] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:35.182288 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.215299 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.221326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b68d-7c23-4ea2-a29b-21f1b4fde3cc None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.254605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.255250 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.255523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.255793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.266242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.267730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.278550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c594b-9de6-4055-99d5-7631a782f800 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:35.282389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.283399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:35.284308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:35.284308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:35.284308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:35.284308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 304/607] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.284617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.314656 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.315260 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.315535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.315718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.315819 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.316448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:35.316742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.318250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.326419 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 304/608] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:35.327222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.396709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a073-9846-4535-b501-eb81c1bceb57 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.421836 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.425391 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c090e-7e7c-4f7b-940c-84c8aadb56e4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.431890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.432493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.432772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.433041 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.433685 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:35.433983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.435400 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.447387 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 305/609] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:35.448211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.463343 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.463968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.464554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.464810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.472302 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.473736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:35.484588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.485662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 305/610] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.486664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.530883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.549021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee50c0-5cbc-49d1-a0f4-879f8d8473ac None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.582901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd4ed0-422d-4999-9e60-31cb20d4cf9b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.583488 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.584070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.584401 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.584685 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.585317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:35.585614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.587045 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.598346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 306/611] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:35.599143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.617509 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.618211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.618515 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.618789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.629544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.631170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:35.645009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.646056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:35.647174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:35.647174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:35.647174 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:35.650789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 306/612] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.651608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.663962 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.700294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f55c-0371-4707-ab35-e787b971fdae None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.733767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.734393 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.734731 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.735027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.741568 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.743064 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.753953 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dcac8-1896-4cc2-8ace-436ddca0f11d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:35.754152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.755216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 307/613] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.756152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.758727 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.794249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.794879 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.795153 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.795418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.796161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:35.796438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.797881 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.815394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 307/614] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:35.816289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.863981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b95e2-3054-4a21-bd99-04a783f8c109 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.883170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:35.897835 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.898478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.898768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.899040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.906957 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.908402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:35.919644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:35.920715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 308/615] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:35.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.924914 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec396f98-fc26-4fb9-926a-582e2a4eea0e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:35.958856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:35.959404 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:35.959677 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:35.959940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:35.960579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:35.960857 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:35.962237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:35.974709 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 308/616] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:35.975695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:35.984310 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.023830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009fd0-da19-4ef3-9b76-c418790a980e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.057075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.057674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.057946 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.058212 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.058945 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:36.059260 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.060716 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.072520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 309/617] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:36.073265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.074618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae5e80-f784-4d29-a2b7-ac4273954a8c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.100665 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.108888 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.109493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.109769 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.110036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.170600 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5546a9e-27e6-443f-82ea-f4979a7ca3d8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.176555 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.178088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.191815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.202875 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.203466 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.203738 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.204000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.204719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:36.205011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.206432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.223567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 310/618] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:36.224150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.280010 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 309/619] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:36.280848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.307234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.321754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9be416-c3de-48dc-a597-797dcf0b5d68 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.355067 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.355712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.355982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.356242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.363347 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.364813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:36.376461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:36.377508 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 20:33:36.378431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:36.379570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78084daf-3ca7-4e5d-89e5-1cbdec6dafe1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.379646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 311/620] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:36.379646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.411984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.412607 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.412881 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.413157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.413879 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=b0822ef274eb4139ae825a9a4ef282ab) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:36.414183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.415647 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.421072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.434622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 310/621] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/role_assignments?user.id=b0822ef274eb4139ae825a9a4ef282ab&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:36.434622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.492990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936688b-e40b-4225-afa4-41086ade12dd None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.536998 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.537972 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.539050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.539341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.542562 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.552409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17d39a-a89e-4175-a4f5-6b640fe692f1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.590007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.590677 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.590951 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.591258 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.604277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.606168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.621314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.622808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:36.624425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:36.625450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:36.626311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:36.626311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:36.626311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:36.626311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 311/622] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:36.627813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.676043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.737445 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbcda2-3a4d-4399-94b2-11460fa7d9b4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.742156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 312/623] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:36.742156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.774997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.775512 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.775781 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.776045 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.776796 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:36.777091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.778533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.795631 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 312/624] 10.222.0.15 () {56 vars in 1139 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:36.796443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.798967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.849606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b0241-6b76-4dd8-a01d-786401c74d16 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.885476 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.886347 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.886786 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.887218 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.888070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:36.888516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.890075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.902771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:36.906351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 313/625] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:36.907548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:36.914833 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad48c0-7640-4aff-87c4-fd79782586ee None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:36.951077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:36.951797 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:36.952140 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:36.952475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:36.963131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:36.964908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:36.979950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:36.981503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:36.982434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:36.982434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:36.982434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:36.982434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 313/626] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:36.982434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.030681 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1472eeb-7353-4841-a573-159531a8350d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.039742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.067611 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.068255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.068561 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.068828 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.090420 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed83b91-1439-4b02-b4b9-bc5bdac92a31 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.124846 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.125464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.125761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.126019 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.132914 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.134369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.137797 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.140110 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.141765 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:37.145787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:37.146975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 314/627] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:37.147899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.249460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 314/628] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:37.250347 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.265386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c80f36-2057-4bb7-8dfa-615424ac65e1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.280118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.302116 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.302672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.302977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.303247 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.303905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:37.304204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.305590 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.322733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 315/629] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:37.322733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.359382 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.362558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee401a1-7e2d-47fa-aed8-da9b656dfac8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.397442 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.398051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.398330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.398636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.399332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:37.399635 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.401078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.417629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 315/630] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:37.417629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.431302 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f139f0-f824-432c-bae7-1b1b6a2993ff None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.473662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.474874 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.475366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.475859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.488518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.489993 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:37.504751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:37.505710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:37.506694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:37.506694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:37.506694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:37.510598 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 316/631] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:37.511425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.529864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c1d0e-9fd8-435e-8aaa-fbf1d51c0ecb None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.540708 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.566169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.566747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.567023 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.567291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.574919 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.576418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:37.589376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:37.590341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:37.591281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 316/632] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:37.591758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.617764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.629351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6ca35-5b84-4101-89bb-bf82f3741384 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.663903 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.664506 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.664783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.665052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.665786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=01102d0faa3845e0a76afc772579e808) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:37.666090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.667551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.682479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 317/633] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/role_assignments?user.id=01102d0faa3845e0a76afc772579e808&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:37.682479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.718612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90598a0-d2be-4cbc-b712-089744b33ea6 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.756663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.757332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.757620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.757891 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.758602 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:37.758908 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.760326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.776468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 317/634] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:37.781754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.803357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.815010 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf85f6d-2d41-464a-8a49-36b999c49d39 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.866736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.866736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.866736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.866736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.867186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:37.867186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.869479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:37.889885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 318/635] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:37.891416 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:37.900936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:37.929209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef5f7-a21b-42ae-b64a-3d5d6cd078a5 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:37.978432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:37.979102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:37.979385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:37.979654 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:37.987176 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:37.988961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:38.001841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:38.002800 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:38.003691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:38.006109 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 318/636] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:38.011403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:38.022269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9060d-cc41-4f4d-8321-a84b9f6b441a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:38.057139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:38.057749 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:38.058072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:38.058345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:38.059109 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=ed5cc105367448a59da0ce5cfe60e175) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:38.059444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:38.061113 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:38.070536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 319/637] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:37 2022] GET /identity/v3/role_assignments?user.id=ed5cc105367448a59da0ce5cfe60e175&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:38.124070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa104f63-daa8-491b-af68-5ef41c191f7c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:38.163038 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:38.164054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:38.164616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:38.165082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:38.166045 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:38.166618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:38.168374 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea22d7a-1cf5-459d-9d74-29f6da8efafe None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:38.183180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:38.187795 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 319/638] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:38.193976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:38.212341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:38.305525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe991d-b168-4fa0-8c2e-6b343bbd991b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:38.341733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:38.342369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:38.342696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:38.342957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:38.343745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=df9d9d38efd14328b4d6230278a49fae) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:38.344052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:38.345499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ad54-98c3-4384-9906-e5d07028e79e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:38.351907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 320/639] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:38 2022] GET /identity/v3/role_assignments?user.id=df9d9d38efd14328b4d6230278a49fae&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:38.694780 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5dc54-417b-4c3e-b6e2-1a1f7b051f48 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:38.695170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5dc54-417b-4c3e-b6e2-1a1f7b051f48 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:38.695371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5dc54-417b-4c3e-b6e2-1a1f7b051f48 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:38.696914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 320/640] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:38.702323 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:38.702642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:38.702920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:38.721517 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:38.722761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:38.791201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 321/641] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:39.121621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5dc54-417b-4c3e-b6e2-1a1f7b051f48 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:39.225634 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5dc54-417b-4c3e-b6e2-1a1f7b051f48 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:39.260483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:39.261114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:39.261391 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:39.261661 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:39.272441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:39.277802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:39.278920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:39.279854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 321/642] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:39.285544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:39.296686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:39.386722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ee588-9617-453a-9fcf-89e27c9b91f2 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:39.421338 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:39.421950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:39.422226 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:39.422515 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:39.423248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:39.423537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:39.424867 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:39.433699 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 322/643] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:39.439073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:39.503274 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:39.545639 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79260592-f774-464b-9768-5dcbabf0165d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:39.580331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:39.580967 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:39.581246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:39.581516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:39.592997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:39.594489 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:39.608955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:39.609914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:39.610822 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:39.610822 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:39.610822 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:39.610822 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 322/644] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:39.616073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:39.686839 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:39.717851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cbe83-a9aa-457f-8655-531f042f37f7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:39.751581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:39.752193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:39.752471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:39.752743 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:39.753397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:39.753697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:39.755099 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:39.767243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 323/645] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:39.772984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:39.876024 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b97d4-4cfb-4bee-9e39-198e7d7c4ee1 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:39.902833 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:39.911756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:39.912420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:39.912700 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:39.912974 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:39.921985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:39.923570 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-e2901581-c14f-4e27-a0bb-531387bbf931 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:39.936567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:39.937632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:39.938645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 323/646] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 27 20:33:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:39.943953 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.049635 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff682-ee19-45df-882c-ee6243f3144c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:40.078816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:40.084989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:40.085606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.085880 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.086148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.086918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:40.087220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:40.088652 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:40.107354 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 324/647] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 27 20:33:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:40.112115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9854f-2d49-4875-8a73-42b8ce3ac0b6 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.112509 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9854f-2d49-4875-8a73-42b8ce3ac0b6 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.112760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.112963 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9854f-2d49-4875-8a73-42b8ce3ac0b6 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.114668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 324/648] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:40.121058 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.121423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.121767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.144444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:40.145918 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:40.224211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29280740-9f71-473b-aeab-a12f32ec2e37 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:40.234485 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 325/649] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:40.265809 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c82fd2-75ad-4a2a-972d-0d789dd5084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:40.266848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82fd2-75ad-4a2a-972d-0d789dd5084d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.267365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82fd2-75ad-4a2a-972d-0d789dd5084d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.267847 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82fd2-75ad-4a2a-972d-0d789dd5084d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.325444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:40.342011 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c82fd2-75ad-4a2a-972d-0d789dd5084d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:40.343954 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c82fd2-75ad-4a2a-972d-0d789dd5084d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:40.449594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 325/650] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 20:33:40.455069 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.508343 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f10d7-00df-45c4-b45c-a3954117b3da None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.508947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f10d7-00df-45c4-b45c-a3954117b3da None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.509418 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f10d7-00df-45c4-b45c-a3954117b3da None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.512394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 326/651] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:40.516813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.517304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.517790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.536948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:40.538539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:40.558198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad3fa5-25ed-4c58-a60c-b25ea9e9d5d3 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:40.559796 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:40.595066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:40.596003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.596351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.596675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.607335 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:40.608786 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:40.608958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 327/652] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 20:33:40.609757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-c182045d-c4b4-49de-890a-5c8b7a26c155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:40.625759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:40.626791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:40.628394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:40.628394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:40.628394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:40.628394 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 326/653] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:40.628619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbda212-74a7-44a8-91e5-8158cb92eb2d None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.628822 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbda212-74a7-44a8-91e5-8158cb92eb2d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.628974 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbda212-74a7-44a8-91e5-8158cb92eb2d None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.630339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 327/654] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:40.635029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbda212-74a7-44a8-91e5-8158cb92eb2d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.636017 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:40.726750 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda56c-3004-4248-8f4d-0713c89a5384 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:40.743958 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbda212-74a7-44a8-91e5-8158cb92eb2d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:40.761494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:40.762067 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.762393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.762701 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] PATH_INFO: `/v3/services/image` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.763393 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:40.764772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-52d826c1-c701-44e1-85ca-ac70526a5fc0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:40.776655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:40.777712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:40.778619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 328/655] 10.222.0.15 () {56 vars in 1105 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:40.779818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.779818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.779818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.790524 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:40.791135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.791434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.791701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.792461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:40.792650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:40.794048 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:40.797882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:40.799105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:40.806206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 328/656] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:40.806968 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.823829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:40.872919 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 329/657] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:40.873790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.899041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:40.931908 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f8e5-d1c4-4665-8540-88a40a147963 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:40.969786 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:40.970388 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:40.970695 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:40.970964 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:40.971595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] RBAC: Adding query filter params (name=image) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:40.971898 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:40.973280 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:40.978490 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 329/658] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:40.978490 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:40.992515 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3424a16-12da-4ea5-9003-571e3c206cc6 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.028838 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.029537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.029815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.030084 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.036778 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.038348 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:41.050481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:41.051386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:41.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 330/659] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:41.053442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.066019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.088849 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eb170-681c-4935-ba78-df622ca052fd None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.124702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.130649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.131304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.131610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.132217 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.132810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.134529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:41.146939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:41.147926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:41.148784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:41.150589 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 330/660] 10.222.0.15 () {56 vars in 1129 bytes} [Sat Aug 27 20:33:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:41.151390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.160141 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fe950-28ac-4d98-8212-816aa7adaa98 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.193579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a549878-fd14-4815-8262-010526193a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.194175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a549878-fd14-4815-8262-010526193a0b None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.194467 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a549878-fd14-4815-8262-010526193a0b None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.194739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a549878-fd14-4815-8262-010526193a0b None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.195375 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a549878-fd14-4815-8262-010526193a0b None admin] RBAC: Adding query filter params (type=image) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.195666 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a549878-fd14-4815-8262-010526193a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.197030 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a549878-fd14-4815-8262-010526193a0b None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.203234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 331/661] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:41.204026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a549878-fd14-4815-8262-010526193a0b None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.274983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d28c1-bf80-4358-8534-d1e04938511b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.313572 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a549878-fd14-4815-8262-010526193a0b None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.315110 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.315725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.316004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.316274 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.316983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.317282 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.318900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.337680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 331/662] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:41.338743 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.342049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.356188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.356796 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.357111 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.357357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.358023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.358330 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.359793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.363071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.370006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 332/663] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:41.370998 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.453351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8b88d-d942-442b-81fd-7b3ce019de80 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.478786 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5aafb-d763-47ed-ba8a-d3cb4bd95cdc None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.490188 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.490842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.491116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.491487 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] PATH_INFO: `/v3/services/network` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.492067 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.493530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:41.502665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:41.503667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:41.504505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 332/664] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:41.505348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.517570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.518182 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.518484 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.518762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.519492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=b0822ef274eb4139ae825a9a4ef282ab) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.519800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.521242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.526982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 333/665] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/role_assignments?user.id=b0822ef274eb4139ae825a9a4ef282ab&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=0f13813da5a84a44829df58f1d837465 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:41.527785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.585875 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.620408 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.632343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c3fbe-135b-4600-83ae-c4387e632d08 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.673483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.674169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.674464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.674751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.675392 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.675687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.677148 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.688438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 333/666] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:41.692586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a3ac5-2d36-47a6-9d59-ed3224791595 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.737183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.738081 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.738551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.739097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.740012 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] RBAC: Adding query filter params (name=network) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.740506 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.742218 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c185da3-fa8d-4ac6-a1ca-bd6009bd7881 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.748209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 334/667] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:41.757519 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:41.874234 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1293ec-5717-4adb-9dff-fc7cd285afe0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:41.913073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:41.919806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:41.920058 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:41.920279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:41.920526 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:41.921164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] RBAC: Adding query filter params (type=network) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:41.921467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:41.923004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6c075-d340-4bf9-bc58-1c4db38f1b65 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:41.927888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 334/668] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:33:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:43.418851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502584d1-3f56-4806-bafc-ffeb381c8c5a None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:43.419388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502584d1-3f56-4806-bafc-ffeb381c8c5a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:43.419695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502584d1-3f56-4806-bafc-ffeb381c8c5a None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:43.421402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 335/669] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:43.426745 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ec53-cfdf-42b1-aa97-4aca617af86c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:43.427174 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ec53-cfdf-42b1-aa97-4aca617af86c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:43.427537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ec53-cfdf-42b1-aa97-4aca617af86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:43.446339 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-8e03ec53-cfdf-42b1-aa97-4aca617af86c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:43.447557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-8e03ec53-cfdf-42b1-aa97-4aca617af86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:43.519139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 335/670] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:43.807340 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020fec-5e22-4026-9265-fac5d1697400 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:43.807734 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020fec-5e22-4026-9265-fac5d1697400 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:43.807930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020fec-5e22-4026-9265-fac5d1697400 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:43.809561 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 336/671] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:43.816829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c292-02c5-4ab5-b10e-e3b198ee5069 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:43.817236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c292-02c5-4ab5-b10e-e3b198ee5069 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:43.817462 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c292-02c5-4ab5-b10e-e3b198ee5069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:43.844939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c684c292-02c5-4ab5-b10e-e3b198ee5069 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:43.846543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c684c292-02c5-4ab5-b10e-e3b198ee5069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:43.849503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a020fec-5e22-4026-9265-fac5d1697400 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:43.934477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 336/672] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:43.988493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a020fec-5e22-4026-9265-fac5d1697400 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:43.997354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed835ea-df1d-42a9-9e83-f3ba4610d2f8 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:43.997631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed835ea-df1d-42a9-9e83-f3ba4610d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:43.997901 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed835ea-df1d-42a9-9e83-f3ba4610d2f8 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.000539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 337/673] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:44.004626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.004904 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.005171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.015965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:44.024065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71724-b782-4549-965a-b62e5a4fe4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:44.024682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71724-b782-4549-965a-b62e5a4fe4c4 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.024963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71724-b782-4549-965a-b62e5a4fe4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.025236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71724-b782-4549-965a-b62e5a4fe4c4 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.025910 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71724-b782-4549-965a-b62e5a4fe4c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:44.026846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:44.027390 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71724-b782-4549-965a-b62e5a4fe4c4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:44.028379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:44.047360 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 337/674] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:33:43 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:33:44.105964 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:44.108235 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb718b3-8156-40e0-9799-2705fd1668fc None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.109219 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb718b3-8156-40e0-9799-2705fd1668fc None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.109716 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb718b3-8156-40e0-9799-2705fd1668fc None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.111745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 338/675] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:44.118612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.119216 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.119712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.122830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 338/676] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:44 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:44.145157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:44.146415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:44.226433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 339/677] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:44 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 20:33:44.288346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:44.392737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d73601-6bcb-4894-874b-2ff9ffab5a46 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:44.427464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:44.428185 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.428405 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.428657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.439440 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:44.444317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:44.445254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:44.446096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 339/678] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:44.451356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:44.456583 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:44.502881 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:44.555491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee71805-d034-4f1f-a97f-9581066d2e1a None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:44.561216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e76a-3be9-47a9-9794-78c2e958c26b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:44.573429 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:44.595508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:44.596176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.596423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.596667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.597329 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:44.597632 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:44.598529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:44.599037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:44.599130 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.599438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.599709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.600533 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:44.602264 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:44.612009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 340/679] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:44.612918 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:44.625044 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 340/680] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:33:44 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:33:44.626950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:44.746154 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a4b63-6251-4e5e-9e37-abeda1f48ec8 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:44.756313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:44.768737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c1d59-a0b2-445e-9a83-72d75251719d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:44.790050 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:44.790825 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.791098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.791364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.792085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:44.793525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:44.818681 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 341/681] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:33:44 2022] POST /identity/v3/services => generated 240 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:44.827589 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:44.828323 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:44.828610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:44.828874 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:44.847270 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:44.848956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:44.865170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:44.866236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:44.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:44.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:44.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:44.867194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 341/682] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:44.875355 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:44.928452 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:44.997299 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bfb6b-512b-48e9-9933-2ab0ae29ae21 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:45.034242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:45.034901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:45.035181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:45.035455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:45.036181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:45.036488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:45.038085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:45.050808 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 342/683] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:45.056234 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:45.158127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452fac4-30d9-4691-924b-53e430da972a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:45.191779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:45.192416 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:45.192694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:45.192955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:45.200859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:45.202325 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:45.213713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:45.215068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:45.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 342/684] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 27 20:33:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:45.221412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:45.320481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:45.323315 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24186e2e-43d9-4086-b2f4-e46e5161497a None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:45.357926 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:45.358556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:45.358831 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:45.359094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:45.359875 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:45.360171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:45.361628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:45.379304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 343/685] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 27 20:33:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:45.384907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:45.407292 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:45.486589 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79db7-cb8e-4050-abd7-4c81d20bf999 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:45.519714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:45.520342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:45.520613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:45.520876 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:45.531623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:45.533135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:45.547749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:45.548718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:45.549950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:45.549950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:45.549950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:45.549950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 343/686] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:45.554805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:45.653111 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d8d7-e8b7-47c3-9de7-8f3c34d8b425 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:45.687348 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:45.687951 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:45.688222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:45.688491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:45.689194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:45.689491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:45.690933 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:45.702341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 344/687] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:45.708161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:45.764988 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:45.809824 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980cac-12b1-4a0c-abc7-0a4950c6ba77 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:45.844016 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:45.844638 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:45.844911 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:45.845177 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:45.852566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:45.854304 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:45.866151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:45.867269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:45.868375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:45.869514 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 344/688] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:45.875783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:45.900903 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:45.983344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a5e3-9bcd-42f3-9dcc-641dbe0b16ff None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:46.016998 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:46.017605 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:46.017877 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:46.018143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:46.018859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:46.019158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:46.020577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa047cbe-111e-443b-8cdc-3976f92f4feb None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:46.033063 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 345/689] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:46.039538 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:46.157341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414ed1-1f64-442e-be38-6266a27c65d3 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:46.175652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:46.195003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3c596-fa36-4b1b-a8e1-01268c9f9fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:46.195666 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3c596-fa36-4b1b-a8e1-01268c9f9fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:46.195946 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3c596-fa36-4b1b-a8e1-01268c9f9fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:46.196217 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3c596-fa36-4b1b-a8e1-01268c9f9fb0 None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/b0822ef274eb4139ae825a9a4ef282ab/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:46.198135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3c596-fa36-4b1b-a8e1-01268c9f9fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=b0822ef274eb4139ae825a9a4ef282ab, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:46.199620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3c596-fa36-4b1b-a8e1-01268c9f9fb0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:46.214522 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 345/690] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:33:46 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/b0822ef274eb4139ae825a9a4ef282ab/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:33:46.306760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098af45-8c16-4e2e-83f8-10e7dd61777e None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:46.306946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098af45-8c16-4e2e-83f8-10e7dd61777e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:46.307212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098af45-8c16-4e2e-83f8-10e7dd61777e None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:46.308923 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 346/691] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:46.314818 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:46.315306 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:46.315680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:46.335975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:46.337197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:46.415284 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 346/692] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:46.737744 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098af45-8c16-4e2e-83f8-10e7dd61777e None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:46.816346 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:46.839225 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098af45-8c16-4e2e-83f8-10e7dd61777e None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:46.873542 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:46.874263 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:46.874542 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:46.874806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] PATH_INFO: `/v3/services/image` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:46.875431 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:46.876886 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:46.888803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:46.890053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:46.890920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 347/693] 10.222.0.15 () {56 vars in 1105 bytes} [Sat Aug 27 20:33:46 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:46.896487 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.005709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897d6c3-7f87-4275-9c6d-c2de8c640980 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.013184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:47.041181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.041792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.042068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.042337 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.043000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:47.043302 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.044691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98faa5-958b-44d0-86b9-89b2749498b8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.049715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 347/694] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:47.055236 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.081360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bc69-43ea-47a8-bbf2-41273f70b7f6 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.081689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bc69-43ea-47a8-bbf2-41273f70b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.081910 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8bc69-43ea-47a8-bbf2-41273f70b7f6 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.083574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 348/695] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:47.090666 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f831-b2d0-4635-8996-186dfc44ea16 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.090956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f831-b2d0-4635-8996-186dfc44ea16 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.091230 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630f831-b2d0-4635-8996-186dfc44ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.109392 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-9630f831-b2d0-4635-8996-186dfc44ea16 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:47.110872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-9630f831-b2d0-4635-8996-186dfc44ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:47.159458 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d059c9-c215-4c73-91df-ac13d2e37646 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.177492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 349/696] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 20:33:47.178793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8aec-c085-45da-9306-ebaa90717363 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.179074 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8aec-c085-45da-9306-ebaa90717363 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.179400 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8aec-c085-45da-9306-ebaa90717363 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.180825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 350/697] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:47.188531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.188990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.189650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.201373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.202100 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.202564 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.202980 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.203720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] RBAC: Adding query filter params (type=image) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:47.204122 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.205709 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.214479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 348/698] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:47.216245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:47.217208 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.218797 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:47.228621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:47.289950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 351/699] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:47.336813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e1aad-a193-4a28-a9e4-2f9304934307 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.371347 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.371950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.372223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.372492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.373191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] RBAC: Adding query filter params (interface=public, service_id=7c405a944fec4eeab8d36b0a8aa37f74, region_id=RegionOne) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:47.373491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.374890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.383152 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 349/700] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/endpoints?service_id=7c405a944fec4eeab8d36b0a8aa37f74&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:47.391606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.427777 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:47.495965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fc3a3-5f74-4d07-a2ed-e944dadb12b4 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.509167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.535618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.536337 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.536612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.536924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.537644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.539114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.545285 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 352/701] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services => generated 1002 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:33:47.592329 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:47.620594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.626728 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb8060-ab13-4fde-9f9b-8281232b6cd2 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.663007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.663680 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.663957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.664228 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.664830 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.666232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:47.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:47.676800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:47.677717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 350/702] 10.222.0.15 () {56 vars in 1129 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:47.683375 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.730899 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:47.740247 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338c4bc-69e2-4c5c-b0af-2fe6fe57528e None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.778909 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.779747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.779857 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.780088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] PATH_INFO: `/v3/services/network` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.780984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.782389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:47.795672 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:47.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:47.797552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 353/703] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:47.803007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.807337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c6b3-1116-4ffb-89b1-4f14b4426fec None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.845149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.846243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.846806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.847323 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.848155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:47.848652 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.850355 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.851956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:47.856685 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 351/704] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:47.862537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:47.936363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43859c7a-a9b0-4d80-9e62-cdaaa87d5126 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.977168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85929b96-e24d-45b4-821a-2b02bdcf1759 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:47.979073 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:47.979925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:47.980418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:47.980893 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:47.981719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] RBAC: Adding query filter params (name=network) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:47.982211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:47.983877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:47.989563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 354/705] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:47.994762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:48.021884 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:48.022522 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.022807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.023113 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.023714 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:48.024014 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:48.025470 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:48.029709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:48.038130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 352/706] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:48.039790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:48.122845 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64dc5a0-8af3-406c-a52f-fbda724f1742 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:48.126718 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:48.169625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:48.170511 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.170790 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.171116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.171747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] RBAC: Adding query filter params (type=network) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:48.171967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bc0ec-ec32-4467-8e7b-724dc7002bca None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:48.172080 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:48.173707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:48.180643 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 355/707] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:33:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:48.186326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:48.210630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:48.211238 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.211556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.211826 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.212531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] RBAC: Adding query filter params (interface=public, service_id=a1e0036fcd9a49b8983af24d3d98d66a, region_id=RegionOne) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:48.212877 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:48.214625 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:48.220203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 353/708] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:33:48 2022] GET /identity/v3/endpoints?service_id=a1e0036fcd9a49b8983af24d3d98d66a&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:48.225806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:48.283375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:48.302989 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaac2e-adcb-4032-aae2-77b2cea57cdb None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:48.326686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33283db3-ef3f-4284-bbaf-bb52ed71da86 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:48.342957 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:48.343946 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.344395 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.344936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.345938 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] RBAC: Adding query filter params (interface=public, service_id=9ca4476783a94bb29fd9d385b8c6952d, region_id=RegionOne) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:48.346430 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:48.348064 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:48.355663 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:48.363503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 356/709] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:33:48 2022] GET /identity/v3/endpoints?service_id=9ca4476783a94bb29fd9d385b8c6952d&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:48.365108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:48.367013 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610933ee-b881-4513-8d4c-f10b7f27a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:48.367635 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610933ee-b881-4513-8d4c-f10b7f27a379 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.367910 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610933ee-b881-4513-8d4c-f10b7f27a379 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.368222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610933ee-b881-4513-8d4c-f10b7f27a379 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.368837 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610933ee-b881-4513-8d4c-f10b7f27a379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:48.371091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610933ee-b881-4513-8d4c-f10b7f27a379 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:48.382687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 354/710] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:33:48 2022] GET /identity/v3/services => generated 1002 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:33:48.481235 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db483-88bc-4ff4-adc6-f7e2c97bbf26 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:48.507920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e48dc-59e0-4d59-876a-b8ad047f4d49 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.508242 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e48dc-59e0-4d59-876a-b8ad047f4d49 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.508467 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e48dc-59e0-4d59-876a-b8ad047f4d49 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.511099 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 355/711] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:48.517136 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.517433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.517676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.520994 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:48.521724 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:48.521997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:48.522266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:48.523018 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:48.524440 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:48.530870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 357/712] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:33:48 2022] GET /identity/v3/services => generated 1002 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:33:48.538193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:48.539602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:48.621143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 356/713] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:48.945052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:48.962574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:49.049659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41aa8-8633-4533-9fd3-e258421c7338 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:49.084587 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:49.085599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.086071 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.086562 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.097653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:33:49.103273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:49.104186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:33:49.105050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:49.107792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 358/714] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:49.113963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:49.213169 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56adb93-dfaf-461f-95b0-163ec67c0301 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:49.233764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:49.249478 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:49.250098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.250371 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.250674 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.251345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:49.251640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:49.253008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:49.261907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 357/715] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:49.267467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:49.343926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:49.369381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28f353-b368-4b59-8553-f9fda0b3e895 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:49.403268 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:49.404234 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.404707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.405192 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.417821 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:49.419548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:49.434278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:49.435271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:49.436156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:49.436156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:49.436156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:49.437940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 359/716] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:49.445838 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:49.557084 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed665c-ad2b-42d7-91c8-4eb8113758f3 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:49.592552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:49.593156 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.593431 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.593697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.594342 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:49.594664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:49.596051 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:49.608536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 358/717] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:49.614277 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:49.722252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4167f08-54fc-4ca1-a3fd-fc37927e294d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:49.747938 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:49.757098 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:49.757993 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.758526 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.767012 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.774659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:49.776322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-e96ce72c-fa81-42bf-afcd-1429a96f7437 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:33:49.795396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:49.796327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 20:33:49.797249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:49.799575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 360/718] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 27 20:33:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:49.805134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:49.818513 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8a42-6b94-461f-bea3-42201154382e None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.818793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8a42-6b94-461f-bea3-42201154382e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.819002 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8a42-6b94-461f-bea3-42201154382e None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.820467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 361/719] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:49.825793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.826076 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.826354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.850586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:49.851788 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:49.857899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:49.927201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9dd8-e3d2-4098-b78c-a086233e64d7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:49.937003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 362/720] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:49.963327 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:49.964303 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:49.964581 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:49.964848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:49.965984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:49.965984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:49.967442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:49.986003 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 359/721] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 27 20:33:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:49.991386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.095873 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbac12-e87a-498f-b74c-a2cd69785c75 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.119330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.128430 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.129047 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.129321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.129585 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.198803 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.200257 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.272897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.301655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 363/722] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:49 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 20:33:50.307426 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.326249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.405071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.409780 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3c6e5-82f0-43e0-b400-eec706944d3d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.419344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b5e2c-d2a2-4cc0-ae67-2fc8448a8489 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.458136 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.458994 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.459258 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.459554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.460172 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.461553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.461944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.462867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.463431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.464213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:50.472160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:50.473196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 20:33:50.474128 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:50.478860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 360/723] 10.222.0.15 () {56 vars in 1105 bytes} [Sat Aug 27 20:33:50 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:50.479859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.481000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.482815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:50.498889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:50.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:50.500735 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:50.500735 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:50.500735 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:50.509331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 364/724] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:50.510650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.599778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.601049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bbd5c-ecc1-4c08-91e3-af574d8481e7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.639340 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.640951 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.641440 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.641930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.642710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c14a7-9db9-4b8f-a11a-55b11a4fd71a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.643045 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] RBAC: Adding query filter params (name=image) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:50.643559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.646161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.652210 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 361/725] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:50.658165 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.685156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.685760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.686036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.686301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.687404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:50.687712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.689390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.695116 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.708740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 365/726] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:50.710320 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.775271 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a0f0-3348-48aa-ac8c-cd4d875dd90d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.808530 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.809130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.809408 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.809682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.810311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:50.810644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.812008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d136f8-349f-4a94-99be-b06920d629b7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.816241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aed929-3941-4d8c-8a35-2775c17a2678 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:50.816690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 362/727] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:50.817873 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9c915-f533-461b-8163-49900cb06bac None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.818150 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9c915-f533-461b-8163-49900cb06bac None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.818425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9c915-f533-461b-8163-49900cb06bac None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.819628 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 363/728] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:50.820638 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc565f7-419f-4a43-94fe-2fc3c113e4e4 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.820912 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc565f7-419f-4a43-94fe-2fc3c113e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.821178 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc565f7-419f-4a43-94fe-2fc3c113e4e4 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.822339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 364/729] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:50.825125 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea51c0-adb3-4988-86d9-31e189f5614f None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.825456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea51c0-adb3-4988-86d9-31e189f5614f None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.825780 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea51c0-adb3-4988-86d9-31e189f5614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.843272 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.844448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-97ea51c0-adb3-4988-86d9-31e189f5614f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:50.845639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-97ea51c0-adb3-4988-86d9-31e189f5614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:50.851859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:50.852496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.852771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.853015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.859885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:50.861340 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:33:50.872692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:50.873713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:50.874651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 366/730] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:50.875171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:50.918845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 365/731] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:50.920035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:50.920322 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:50.920575 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:50.949285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:50.950554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:50.968505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:50.981114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5bf15-a226-4c2c-bd2d-4651f65d4eb8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.017380 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.017997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.018301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.018658 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.019381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.020827 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.030295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 366/732] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:51.030295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.055607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 367/733] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:33:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:51.148793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca454c-0560-43a9-8a8f-7c8f4b7948a2 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.192822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.193448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.193721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.193988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.194773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:51.195075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.196504 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.210099 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 367/734] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:51.216616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.246099 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.260705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:51.266614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:51.346497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5543d-bb3b-474b-aee7-7bf0e3cb2201 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.362071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862f573-8a53-4d10-9f80-5431e171720e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.389830 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.390789 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.391066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.391342 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.392072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=b0822ef274eb4139ae825a9a4ef282ab) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:51.392375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.393850 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.398284 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.399153 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.399605 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.399770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 368/735] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/role_assignments?user.id=b0822ef274eb4139ae825a9a4ef282ab&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=0f13813da5a84a44829df58f1d837465 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:51.400227 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.400658 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.401377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.402917 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:51.415488 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:51.417107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 20:33:51.417952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:51.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 368/736] 10.222.0.15 () {56 vars in 1129 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:51.428170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.513815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:51.552470 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c2b02-b245-4c0a-b1b7-10f30a6bf95c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.594868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.595559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.595838 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.596107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.596762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:51.597058 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.598536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.604501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 369/737] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:51.610230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.656644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddbc11-01fd-4dd8-bce2-dc97389e0674 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.667833 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:51.697854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.698523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.698799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.699063 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] PATH_INFO: `/v3/services/network` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.699645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.701108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:51.710564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:51.711550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:51.712410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 369/738] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:51.717928 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.730029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc42c8-26bb-49f0-82f7-8c0d12e85878 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.766119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.767618 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.768109 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.769046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:51.769542 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.771277 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.773604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:51.781804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 370/739] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:51.784264 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.850363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e670e-54f1-4c08-9bb2-d97e13915265 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.892001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.892730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.893013 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.893402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.894042 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] RBAC: Adding query filter params (name=network) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:51.894337 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.895881 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:51.902483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 370/740] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:51.908376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:51.926098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c09aa-16c2-471f-8405-e0dca6078828 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:51.952484 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:51.966673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:51.967286 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:51.967561 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:51.967827 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:51.968513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:51.970129 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:52.002471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 371/741] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:33:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:52.044118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa081274-1e5c-4829-91b4-307e94a76a43 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:52.091597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:52.092263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:52.092542 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:52.092860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:52.093549 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] RBAC: Adding query filter params (type=network) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:52.093853 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:52.095419 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b3d2-5790-48e3-8593-6e4a6f214cf3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:52.101694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 371/742] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:33:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:52.111835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:52.175988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:52.221862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b711-508b-4003-98d5-beed9d546846 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:52.256692 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc589c-71cc-4d02-8eca-1df919f25113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:52.257326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc589c-71cc-4d02-8eca-1df919f25113 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:52.257609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc589c-71cc-4d02-8eca-1df919f25113 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:52.257908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc589c-71cc-4d02-8eca-1df919f25113 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:52.258604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc589c-71cc-4d02-8eca-1df919f25113 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:52.260032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc589c-71cc-4d02-8eca-1df919f25113 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:52.284046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 372/743] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:33:52 2022] POST /identity/v3/endpoints => generated 337 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:53.375144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726a9a-d27a-4c14-91e1-0effe48ba503 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:53.375691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726a9a-d27a-4c14-91e1-0effe48ba503 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:53.375691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00726a9a-d27a-4c14-91e1-0effe48ba503 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:53.376951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 372/744] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:53.382475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818daa14-c903-4ba0-87b6-51d33cab7826 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:53.382907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818daa14-c903-4ba0-87b6-51d33cab7826 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:53.383077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818daa14-c903-4ba0-87b6-51d33cab7826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:53.403065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-818daa14-c903-4ba0-87b6-51d33cab7826 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:53.404303 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-818daa14-c903-4ba0-87b6-51d33cab7826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:53.482925 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 373/745] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:53 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:53.663808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495029d-1f31-49f8-bca7-901b19b4673f None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:53.663996 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495029d-1f31-49f8-bca7-901b19b4673f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:53.664252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495029d-1f31-49f8-bca7-901b19b4673f None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:53.665581 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 373/746] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:53.671090 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:53.671438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:53.671715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:53.689975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:53.691195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:53.722822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:53.763552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 374/747] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:53 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:53.812376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495029d-1f31-49f8-bca7-901b19b4673f None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:53.916421 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:53.923774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495029d-1f31-49f8-bca7-901b19b4673f None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:53.959408 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:53.960004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:53.960278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:53.960544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.030020 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.031542 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.092039 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:54.134464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:54.143904 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 374/748] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:33:53 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 20:33:54.149795 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:54.200795 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eff80-b649-4d79-8ee3-b1851e5c91af None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:54.237511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:54.238227 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.238532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.238800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.239384 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.240987 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:54.250233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:54.251543 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:54.252695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 375/749] 10.222.0.15 () {56 vars in 1132 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:54.256506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505d29c-f37a-472a-b070-e95264000244 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:54.257203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:54.290415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:54.291540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:54.292165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.292437 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.292706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.302594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.304035 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-1a7706a1-ffb8-4995-8ca9-c5448a8c698b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:33:54.318241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:54.319236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 375/750] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a54645-b6f3-4e7f-9239-6322490ae5c5 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a54645-b6f3-4e7f-9239-6322490ae5c5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a54645-b6f3-4e7f-9239-6322490ae5c5 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 376/751] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:54.326173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a54645-b6f3-4e7f-9239-6322490ae5c5 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:54.371500 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc7af6-ee67-4afb-acbd-08e52f8a43ef None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:54.375144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:54.404565 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:54.405152 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.405444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.405706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.406331 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:54.406676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.408023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb452f3-8d89-4a76-ba5e-e515356ae5db None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.413108 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 376/752] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:54.415135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.415570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.415840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.427127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a54645-b6f3-4e7f-9239-6322490ae5c5 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:54.433314 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:54.434529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:54.461296 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:54.461840 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.462114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.462381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.463057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:54.463354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.465096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.476614 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 377/753] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:33:54.477388 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:54.506492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 377/754] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:54 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:54.590560 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf3053-8389-4844-8899-fd1cb91ab424 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:54.601648 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:54.630360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:54.631094 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.631346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.631684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.632321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:54.632626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.634071 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.639444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 378/755] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:54.825291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:54.852483 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:54.928571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4f4e-7e18-4a10-89d2-9519fd4f9b31 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:54.963148 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:54.964073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:54.964346 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:54.964613 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:54.965194 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:54.966586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:33:54.975481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:33:54.976511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:33:54.977336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 378/756] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:33:54.982693 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:55.082917 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ed02a-8704-48ae-bd66-e9e1c812a77a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:55.117889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:55.118480 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:55.118787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:55.119054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:55.119675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:55.119966 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:55.121328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadd39d-ced4-45b5-a3c8-c2c01fc227f3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:55.126344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 379/757] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:55.131901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:55.223365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:55.234856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e2011-9dd8-442a-b44b-853757fcf09f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:55.269275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:55.269883 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:55.270161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:55.270437 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:55.271107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:33:55.271411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:55.272789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77730ce7-ee0c-49e6-8cbe-dd2e2c571658 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:55.277204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 379/758] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:33:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:33:56.856305 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d734c7-44c2-4595-bb90-ba3acd1e9424 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:56.856872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d734c7-44c2-4595-bb90-ba3acd1e9424 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:56.856872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d734c7-44c2-4595-bb90-ba3acd1e9424 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:56.858157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 380/759] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:56.863472 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae20a4-574c-465e-90c5-156de25231a2 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:56.863892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae20a4-574c-465e-90c5-156de25231a2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:56.864020 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae20a4-574c-465e-90c5-156de25231a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:56.882532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-cbae20a4-574c-465e-90c5-156de25231a2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:56.883768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-cbae20a4-574c-465e-90c5-156de25231a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:56.956642 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 380/760] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:56 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:33:57.274939 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d734c7-44c2-4595-bb90-ba3acd1e9424 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:57.315112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:57.382095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d734c7-44c2-4595-bb90-ba3acd1e9424 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:57.418429 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e809f-636e-4c8b-81b2-63aa5d0f29b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:57.419059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e809f-636e-4c8b-81b2-63aa5d0f29b4 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:57.419333 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e809f-636e-4c8b-81b2-63aa5d0f29b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:57.419599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e809f-636e-4c8b-81b2-63aa5d0f29b4 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:57.420242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e809f-636e-4c8b-81b2-63aa5d0f29b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:57.421603 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e809f-636e-4c8b-81b2-63aa5d0f29b4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:57.436680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 381/761] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:33:57 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:57.446823 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f5d2-da7c-4b5f-be96-a940d155e991 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:57.447111 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f5d2-da7c-4b5f-be96-a940d155e991 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:57.447409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14f5d2-da7c-4b5f-be96-a940d155e991 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:57.448805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 381/762] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:33:57.455009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379a0f-21ee-4fff-a6c6-e35c9ab113ba None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:57.455302 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379a0f-21ee-4fff-a6c6-e35c9ab113ba None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:57.455567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a379a0f-21ee-4fff-a6c6-e35c9ab113ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:57.475884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-5a379a0f-21ee-4fff-a6c6-e35c9ab113ba None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:57.477124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-5a379a0f-21ee-4fff-a6c6-e35c9ab113ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:57.557502 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 382/763] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:57 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 20:33:57.883992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f5d2-da7c-4b5f-be96-a940d155e991 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:33:57.972872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:33:57.990098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14f5d2-da7c-4b5f-be96-a940d155e991 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:33:58.022994 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547465-a216-405c-a2ab-ca3c90dd6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:33:58.023591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547465-a216-405c-a2ab-ca3c90dd6cea None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:58.023863 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547465-a216-405c-a2ab-ca3c90dd6cea None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:58.024123 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547465-a216-405c-a2ab-ca3c90dd6cea None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:58.024768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547465-a216-405c-a2ab-ca3c90dd6cea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:33:58.026122 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547465-a216-405c-a2ab-ca3c90dd6cea None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:33:58.040963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 382/764] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:33:57 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:33:59.582557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b89369-02fa-4441-9e0e-3c0e1052bd13 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:59.583122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b89369-02fa-4441-9e0e-3c0e1052bd13 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:59.583122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b89369-02fa-4441-9e0e-3c0e1052bd13 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:59.584503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 383/765] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:33:59.590082 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:33:59.590508 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:33:59.590662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:33:59.609624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:33:59.610879 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:33:59.687354 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 383/766] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:33:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:00.006289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b89369-02fa-4441-9e0e-3c0e1052bd13 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.035157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:00.118029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b89369-02fa-4441-9e0e-3c0e1052bd13 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.153115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.153671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.153942 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.154202 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.154819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.156225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-1f1a3f04-ecb7-47ed-811c-531602b5dfc4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:00.165441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:00.166413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:00.168000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 384/767] 10.222.0.15 () {56 vars in 1132 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:00.172846 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.187448 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0a90-19a8-4f7a-a67a-8f4ba10f7564 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.187701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0a90-19a8-4f7a-a67a-8f4ba10f7564 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.187974 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e0a90-19a8-4f7a-a67a-8f4ba10f7564 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.189400 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 385/768] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:00.194085 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.194367 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.194675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.212575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:00.214078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:00.292783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 386/769] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:00 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 20:34:00.368302 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:00.403013 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18e05-531a-4c36-bc12-78d0e555ac5b None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.437697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.438223 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.438499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.438769 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.439396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:00.439692 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.441056 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.445947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 384/770] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:00.451836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.470659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:00.554403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29895e5-e992-431e-a44f-a0bf093ec2e5 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.588900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.589478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.589750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.590009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.590667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:00.590964 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.592337 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.597115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 387/771] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:00.603498 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.619747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.698355 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:00.707046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ea7ab-0531-40db-95b9-1f694f3559d4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.717498 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b974e-4043-469f-9cff-99cb63d5a58d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.740596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.741202 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.741485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.741746 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.742458 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] RBAC: Adding query filter params (interface=public, service_id=f430d7de483c4b6599f738e4de4fd49b, region_id=RegionOne) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:00.742768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.744134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.745563 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:00.749630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 385/772] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/endpoints?service_id=f430d7de483c4b6599f738e4de4fd49b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:00.752309 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.752934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.753206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.753470 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.754074 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.755349 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.755478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:00.764358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:00.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:00.766537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 388/773] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:34:00.771552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.859071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbd999-2a87-416c-a106-76bfedbf6dce None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.876574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f36787-cd5c-4722-b24e-12be63281a05 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:00.895872 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.896478 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.896770 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.897016 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.897637 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.899046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.905006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 386/774] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 20:34:00.909409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:00.910034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:00.910308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:00.910610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:00.911332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:00.911632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:00.913037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:00.918343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 389/775] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:34:00.924386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:00.992805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:01.036525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ffd7-5a79-4a5d-a1c3-362705f566d9 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:01.073580 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:01.074197 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:01.074485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:01.074774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:01.075419 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:01.075719 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:01.077093 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:01.082357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 387/776] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:34:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:01.090645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:01.102839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:01.193015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02e65-98a2-4acd-bf8c-e6a176944293 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:01.227358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:01.227951 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:01.228219 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:01.228481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:01.229169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] RBAC: Adding query filter params (interface=public, service_id=8ed2423c04a549238b873cde833276af, region_id=RegionOne) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:01.229465 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:01.230861 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648800a-d8e9-49cd-bd80-f732303f79a3 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:01.235917 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 390/777] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:34:01 2022] GET /identity/v3/endpoints?service_id=8ed2423c04a549238b873cde833276af&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:01.241755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:01.345134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4d59a-dba4-45ca-a6fe-2ade7f1ede0e None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:01.370518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:01.379656 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786b6f-63cb-4b0f-948b-f0c99f0fa39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:01.380291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786b6f-63cb-4b0f-948b-f0c99f0fa39f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:01.380568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786b6f-63cb-4b0f-948b-f0c99f0fa39f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:01.380835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786b6f-63cb-4b0f-948b-f0c99f0fa39f None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:01.381450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d786b6f-63cb-4b0f-948b-f0c99f0fa39f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:01.382836 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d786b6f-63cb-4b0f-948b-f0c99f0fa39f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:01.388850 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 388/778] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:34:01 2022] GET /identity/v3/services => generated 1498 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:34:03.056835 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec031-e1bb-41da-892d-5d623306de4e None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.057420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec031-e1bb-41da-892d-5d623306de4e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.057420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec031-e1bb-41da-892d-5d623306de4e None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.058726 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 391/779] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:03.064041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab4aa8-995f-4d6e-a945-06477260da4a None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.064456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab4aa8-995f-4d6e-a945-06477260da4a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.064679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab4aa8-995f-4d6e-a945-06477260da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.083957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-0dab4aa8-995f-4d6e-a945-06477260da4a None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:03.085154 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-0dab4aa8-995f-4d6e-a945-06477260da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:03.155553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 389/780] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:03.474755 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec031-e1bb-41da-892d-5d623306de4e None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:03.529939 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439e5ec-1630-45a9-aff2-7e5b1db3a79b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.530197 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439e5ec-1630-45a9-aff2-7e5b1db3a79b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.530482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439e5ec-1630-45a9-aff2-7e5b1db3a79b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.531790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 390/781] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:03.536799 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.537073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.537345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.546376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:03.555665 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:03.556878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:03.577737 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec031-e1bb-41da-892d-5d623306de4e None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:03.611872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:03.612499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.612787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.613036 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.613618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:03.615106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:03.623327 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 391/782] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:03.624517 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:03.625642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:03.626623 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 392/783] 10.222.0.15 () {56 vars in 1132 bytes} [Sat Aug 27 20:34:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:03.630814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:03.676544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:03.726556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367ea5-f145-4a53-9454-cfacf7ee7e15 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:03.760823 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:03.761415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.761687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.761949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.762616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:03.762914 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:03.764262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:03.768922 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 392/784] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 27 20:34:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:34:03.774969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:03.878586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cc929-98e4-4976-bafa-9c63e6a35012 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:03.914391 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:03.915026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:03.915298 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:03.915569 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:03.916194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:03.916492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:03.917866 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:03.919899 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:03.923490 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 393/785] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 27 20:34:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:03.929219 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:03.938842 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:04.029318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711e63-d873-46c0-b89a-82ac95453ab2 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:04.036344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c864d-7146-4df8-b04d-a689594d8876 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:04.042689 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:04.064801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:04.065397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:04.065686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:04.065948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:04.066663 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:04.068097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:04.071029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:04.071651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:04.071923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:04.072181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:04.072763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:04.074102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:04.082841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:04.083870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:04.085034 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 394/786] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:34:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:34:04.090391 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:04.099895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 393/787] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:34:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:34:04.156992 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:04.199441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5c7f4-916a-4fce-8bcc-07db3a4696df None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:04.242793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:04.243401 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:04.243678 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:04.243935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:04.244566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:04.244857 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:04.246268 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:04.251727 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 395/788] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:34:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:34:04.257756 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:04.357856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23b6e5-015c-4d4c-a227-f54aa0be8f31 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:04.391893 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:04.392493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:04.392765 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:04.393034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:04.393661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:04.393963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:04.395401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ef43-0d8a-4c53-ab69-1fdaa22c4338 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:04.400282 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 394/789] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 27 20:34:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:04.406137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:04.510835 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee6571-b7d9-4045-99e9-646aff5853d0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:04.533612 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:04.546355 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb6b8-92cc-48e4-92f9-04a97b04a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:04.546989 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb6b8-92cc-48e4-92f9-04a97b04a60d None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:04.547261 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb6b8-92cc-48e4-92f9-04a97b04a60d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:04.547522 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb6b8-92cc-48e4-92f9-04a97b04a60d None admin] PATH_INFO: `/v3/endpoints` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:04.548182 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb6b8-92cc-48e4-92f9-04a97b04a60d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:04.549545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb6b8-92cc-48e4-92f9-04a97b04a60d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:04.570661 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 396/790] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:34:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:34:06.262719 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b228d-1376-48bb-b767-a63d8a857a63 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:06.263341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b228d-1376-48bb-b767-a63d8a857a63 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:06.263341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b228d-1376-48bb-b767-a63d8a857a63 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:06.264551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 395/791] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:06.270057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280df635-f98d-47ee-9a47-72fdda8bffff None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:06.270546 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280df635-f98d-47ee-9a47-72fdda8bffff None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:06.270647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280df635-f98d-47ee-9a47-72fdda8bffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:06.289827 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-280df635-f98d-47ee-9a47-72fdda8bffff None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:06.291060 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-280df635-f98d-47ee-9a47-72fdda8bffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:06.366050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 397/792] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:06.691370 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b228d-1376-48bb-b767-a63d8a857a63 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:06.731240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:06.732015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738ac0-032f-4ec8-9177-6affcf0a18e8 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:06.732518 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738ac0-032f-4ec8-9177-6affcf0a18e8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:06.732714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738ac0-032f-4ec8-9177-6affcf0a18e8 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:06.734099 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 398/793] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:06.739734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:06.740009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:06.740275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:06.758620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:06.759814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:06.803896 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b228d-1376-48bb-b767-a63d8a857a63 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:06.829687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 399/794] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:06.837179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:06.837809 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:06.838086 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:06.838696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:06.839283 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:06.840655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:06.849552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:06.851205 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:06.852668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 396/795] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:34:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:06.856610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:06.890702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:06.957205 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e7e6b-eaa7-4de1-9ac9-cdb2df084f3e None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:06.994601 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:06.995212 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:06.995488 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:06.995756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:06.996393 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] RBAC: Adding query filter params (name=compute) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:06.996690 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:06.998067 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:07.003095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 400/796] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:07.009114 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:07.108155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:07.112062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1f149-fb72-40ca-88df-c48d84354190 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:07.146358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:07.146986 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:07.147263 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:07.147529 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:07.148155 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:07.148448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:07.149807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:07.153157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:07.154619 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 397/797] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:07.272628 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:07.277014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687689f8-4f82-4562-b9a4-ebf27e461bbd None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:07.316981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:07.317596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:07.317867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:07.318137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:07.318821 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:07.320263 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:07.322896 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING keystone.server.flask.common [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 20:34:07.341246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.sql.core [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 20:34:07.341246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 20:34:07.341246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [parameters: {'id': 'b41b91d0be514669a12876190151293f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 20:34:07.341246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94819) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b41b91d0be514669a12876190151293f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b41b91d0be514669a12876190151293f. Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application conn.query(q) Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:34:07.357596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result.read() Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 27 20:34:07.358592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application next(self.gen) Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application yield resource Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application next(self.gen) Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise self.value Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application session.commit() Aug 27 20:34:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.session.flush() Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application compat.raise_( Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 20:34:07.360631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 20:34:07.361618 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application conn.query(q) Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result.read() Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:34:07.362852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [parameters: {'id': 'b41b91d0be514669a12876190151293f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:07.364139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:07.365131 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b41b91d0be514669a12876190151293f. Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:07.366252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 401/798] 10.222.0.15 () {60 vars in 1140 bytes} [Sat Aug 27 20:34:07 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:07.366970 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:07.467695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757788-6373-40c4-8bf4-d28f6d06e3b4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:07.501550 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:07.502164 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:07.502468 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:07.502732 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:07.509420 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:07.510907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-1f8f14c2-68e7-4186-82b1-cd9216bca5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:34:07.522411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:07.523425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:07.524401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 398/799] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:07.529747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:07.634750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207e51-c293-4157-92ee-05168daab6a8 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:07.669981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:07.670616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:07.670885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:07.671146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:07.671804 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:07.672097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:07.673721 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d752f-2e1a-49f2-8e35-05f353f0b5cd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:07.695026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 402/800] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:09.293548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44be0f-b70e-4404-90fd-6d3fef97657f None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:09.294137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44be0f-b70e-4404-90fd-6d3fef97657f None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:09.294137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44be0f-b70e-4404-90fd-6d3fef97657f None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:09.295425 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 399/801] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:09.300882 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c628-2507-4849-af01-f0558636e643 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:09.301331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c628-2507-4849-af01-f0558636e643 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:09.301431 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8c628-2507-4849-af01-f0558636e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:09.320248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-5ed8c628-2507-4849-af01-f0558636e643 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:09.321749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-5ed8c628-2507-4849-af01-f0558636e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:09.332628 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:09.393424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 403/802] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:09.711865 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44be0f-b70e-4404-90fd-6d3fef97657f None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:09.739034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:09.821843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44be0f-b70e-4404-90fd-6d3fef97657f None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:09.855706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e547a-83f2-48e3-8d53-197fe2159bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:09.856306 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e547a-83f2-48e3-8d53-197fe2159bff None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:09.856577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e547a-83f2-48e3-8d53-197fe2159bff None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:09.856841 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e547a-83f2-48e3-8d53-197fe2159bff None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:09.857483 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e547a-83f2-48e3-8d53-197fe2159bff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:09.858871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e547a-83f2-48e3-8d53-197fe2159bff None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:09.874254 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 400/803] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:34:09 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:34:09.905608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225774ba-d638-4667-b152-3ca937c84fc8 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:09.905997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225774ba-d638-4667-b152-3ca937c84fc8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:09.906275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225774ba-d638-4667-b152-3ca937c84fc8 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:09.907687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 404/804] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:09.913869 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:09.914129 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:09.914422 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:09.934006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:09.935254 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:10.013263 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 401/805] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:09 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:10.337283 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225774ba-d638-4667-b152-3ca937c84fc8 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:10.442810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225774ba-d638-4667-b152-3ca937c84fc8 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:10.477652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:10.478241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:10.478540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:10.478802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:10.479424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:10.480845 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:10.495813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.sql.core [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 20:34:10.495813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 20:34:10.495813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [parameters: {'user_id': 'a0d95e0f2b5e42a487ed6747657f972b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 20:34:10.495813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94819) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application conn.query(q) Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result.read() Aug 27 20:34:10.502432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 20:34:10.503352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application next(self.gen) Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application yield resource Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application next(self.gen) Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise self.value Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application session.commit() Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 20:34:10.504328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.session.flush() Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application compat.raise_( Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 20:34:10.505195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 20:34:10.506084 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application conn.query(q) Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application result.read() Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 20:34:10.507003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a0d95e0f2b5e42a487ed6747657f972b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:10.507838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 27 20:34:10.508607 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:10.509548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 405/806] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 27 20:34:10 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:10.514180 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:10.524567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:10.620635 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56953ca-b0c3-496d-9374-dd63065ca924 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:10.654667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:10.655281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:10.655554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:10.655815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:10.664034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:10.664034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-328f1d10-eede-4897-beb4-2e096fcfa98e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:34:10.676183 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:10.677233 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:10.678234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 402/807] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:34:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:10.683598 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:10.695864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:10.786516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051032b-1a9d-450d-8bb4-f0dedf37914d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:10.824206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:10.824807 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:10.825079 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:10.825346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:10.826046 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:10.826343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:10.828006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289930b5-6332-4ad1-8fa8-cdfad0a9f50f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:10.865164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 406/808] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 27 20:34:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:12.050274 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8d6d-544d-4c2b-be14-8ed5485f9b73 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:12.051251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8d6d-544d-4c2b-be14-8ed5485f9b73 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:12.051251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8d6d-544d-4c2b-be14-8ed5485f9b73 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:12.053490 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 403/809] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:12.059970 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:12.060422 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:12.060514 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:12.085156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:12.086688 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:12.147856 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:12.157166 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 407/810] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:12 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:12.474514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c8d6d-544d-4c2b-be14-8ed5485f9b73 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:12.549119 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:12.587940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c8d6d-544d-4c2b-be14-8ed5485f9b73 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:12.626106 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:12.626766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:12.627052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:12.627320 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:12.627912 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:12.629291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:12.638868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:12.639907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:34:12.640773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 404/811] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:34:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:12.646283 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:12.765891 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104a95a-31ad-4656-aac8-51961b2083b7 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:12.803935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:12.804538 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:12.804814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:12.805081 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:12.806102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:12.806102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:12.807657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:12.813379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 408/812] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:12.819617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:12.925060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050477a-990d-41cf-b464-13d572ab7319 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:12.955315 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:12.961165 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:12.961762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:12.962047 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:12.962303 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:12.962958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:12.963571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:12.964948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:12.969964 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 405/813] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:12.976319 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:13.040083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:13.082254 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6cc25-e28a-4d7f-86ce-1860a17b3b3d None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:13.127900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:13.128503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:13.128773 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:13.129018 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:13.129806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] RBAC: Adding query filter params (interface=public, service_id=88789eb74f834cb1be1275fce5d7ee16, region_id=RegionOne) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:13.130099 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:13.131503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681986e-e774-40c7-b876-a4b3e7fc7cb5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:13.137544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 409/814] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:34:12 2022] GET /identity/v3/endpoints?service_id=88789eb74f834cb1be1275fce5d7ee16&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:13.144117 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:13.256815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2e43d-bac7-4c46-b233-9b2cdccc8158 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:13.291812 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c4e0c-3e58-4d74-8736-f1c137fa58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:13.292324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c4e0c-3e58-4d74-8736-f1c137fa58c9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:13.292599 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c4e0c-3e58-4d74-8736-f1c137fa58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:13.292864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c4e0c-3e58-4d74-8736-f1c137fa58c9 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:13.293464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c4e0c-3e58-4d74-8736-f1c137fa58c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:13.294856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c4e0c-3e58-4d74-8736-f1c137fa58c9 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:13.301175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 406/815] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:34:13 2022] GET /identity/v3/services => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:34:15.462414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c399-68fa-4b73-98bb-da35bf8c0d62 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:15.463319 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c399-68fa-4b73-98bb-da35bf8c0d62 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:15.463319 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3c399-68fa-4b73-98bb-da35bf8c0d62 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:15.464643 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 410/816] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:34:15.470059 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:15.470547 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:15.470640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:15.490585 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:34:15.491762 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:34:15.548729 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:15.560914 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 407/817] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:34:15 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:34:15.885176 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3c399-68fa-4b73-98bb-da35bf8c0d62 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:15.991904 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3c399-68fa-4b73-98bb-da35bf8c0d62 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:16.025942 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:16.041858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:16.042496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:16.042779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:16.043972 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:16.043972 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:16.045075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:34:16.054169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:34:16.058671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:34:16.059689 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 411/818] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:34:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:34:16.063181 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:16.168490 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab6ca-0392-4c3a-a81e-05880641e896 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:16.217453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:16.218052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:16.218326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:16.218624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:16.219255 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:16.219549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:16.220915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:16.225950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 408/819] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:34:16.231931 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:16.336112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f668482-c2bb-415c-988b-664dce6770ba None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:16.373724 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:16.374317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:16.374619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:16.374885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:16.375514 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:34:16.375808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:16.377179 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea7d0d-c983-425d-a005-8ad51b4069ab None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:16.382223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 412/820] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 27 20:34:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:34:16.388588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:34:16.447159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:16.496822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6d0e7-890d-4d1e-8173-904efcd7e880 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:34:16.532118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09805fe-48f7-440d-906e-21f5cb123a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:34:16.532707 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09805fe-48f7-440d-906e-21f5cb123a66 None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:34:16.532976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09805fe-48f7-440d-906e-21f5cb123a66 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:34:16.533241 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09805fe-48f7-440d-906e-21f5cb123a66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:34:16.533899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09805fe-48f7-440d-906e-21f5cb123a66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:34:16.535315 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09805fe-48f7-440d-906e-21f5cb123a66 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:34:16.558289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 409/821] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:34:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:34:26.380011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=74 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:34:26.553651 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=44,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:18.273252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94e796-c968-4425-bf65-697221aa19da None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:18.273252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94e796-c968-4425-bf65-697221aa19da None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:18.273252 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94e796-c968-4425-bf65-697221aa19da None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:18.274001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 413/822] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:18.279361 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:18.279826 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:18.279928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:18.299758 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:18.301412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:18.399021 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 410/823] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:18.739866 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94e796-c968-4425-bf65-697221aa19da None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:18.880116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94e796-c968-4425-bf65-697221aa19da None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:18.929679 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:18.930358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:18.930652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:18.930879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:18.943852 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:18.945632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:18.964271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:18.965534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:18.966527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:18.966527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:18.966527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:18.966527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 414/824] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:18.972873 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:19.112477 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd43af-dd03-4a5c-a157-efdc25e14d86 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:19.143344 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:19.153161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:19.153805 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:19.154095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:19.154426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:19.155195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:19.155491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:19.156915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a93379-c665-4536-85b4-3a9d05b2242d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:19.169068 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 411/825] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:19.175683 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:19.232555 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:19.286489 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f173dc-8375-4d61-810e-017bf9e03019 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:19.322167 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b9116-c9f7-4c13-a03d-b9405da37bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:19.322864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b9116-c9f7-4c13-a03d-b9405da37bbd None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:19.323212 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b9116-c9f7-4c13-a03d-b9405da37bbd None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:19.323481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b9116-c9f7-4c13-a03d-b9405da37bbd None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:19.324189 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b9116-c9f7-4c13-a03d-b9405da37bbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:19.325616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b9116-c9f7-4c13-a03d-b9405da37bbd None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:19.350156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 415/826] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 27 20:35:19 2022] POST /identity/v3/users => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:35:21.792184 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970add8d-856d-4d81-ab13-d2b6744e0d4b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:21.792840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970add8d-856d-4d81-ab13-d2b6744e0d4b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:21.792840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970add8d-856d-4d81-ab13-d2b6744e0d4b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:21.794034 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 412/827] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:21.800049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:21.800523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:21.800608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:21.819670 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:21.820979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:21.895436 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 416/828] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:22.215927 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970add8d-856d-4d81-ab13-d2b6744e0d4b None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:22.325692 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970add8d-856d-4d81-ab13-d2b6744e0d4b None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:22.364678 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:22.365416 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:22.365722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:22.365997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:22.376860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:35:22.382646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:22.383579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:22.385095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 413/829] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:22.390631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:22.440588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:22.507002 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c5d5-4a43-4f63-a8f0-884a2094f4dc None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:22.544023 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:22.544635 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:22.544909 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:22.545183 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:22.545862 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:22.546158 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:22.547606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:22.555773 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 417/830] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:22.561916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:22.618008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:22.684744 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582253-8309-4b7d-9744-4eab7900d5e3 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:22.727458 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:22.728084 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:22.728356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:22.728670 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:22.741360 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:22.743130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:22.759105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:22.760193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:22.761115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:22.761115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:22.761115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:22.761115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 414/831] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:22.766269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:22.876530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:22.880331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228168-5c48-4d84-be88-7e317556cfe2 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:22.918832 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:22.919437 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:22.919710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:22.919975 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:22.920620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:22.920914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:22.922398 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:22.935760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 418/832] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:22.941362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:23.048990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:23.052726 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9221b4-2254-40df-bfb1-5a7c9ba873f1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:23.089787 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:23.090421 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:23.090723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:23.090996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] PATH_INFO: `/v3/users/placement` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:23.098968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:23.100456 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:35:23.112451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:23.113513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:23.114492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:23.118513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 415/833] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:23.119593 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:23.234995 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1550b4-c71c-46f4-9ec4-b72ce7fbd246 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:23.271383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:23.272032 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:23.272266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:23.272533 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:23.273262 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:23.273557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:23.275052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:23.296909 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 419/834] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 27 20:35:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:35:23.302829 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:23.405400 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b94d7-a3b7-438c-915b-f5532663714d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:23.443167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:23.443717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:23.444033 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:23.444464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:23.475753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:23.520612 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:23.522038 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:23.623501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 416/835] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:35:23 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 20:35:23.629328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:23.648662 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:23.732464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507e19d-856d-4458-9c25-fefd27424321 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:23.768650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:23.769276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:23.769545 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:23.769807 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:23.779523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:23.780960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:23.795906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:23.797120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:23.798237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:23.798237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:23.798237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:23.798237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 420/836] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:23.802996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:23.867399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:23.913250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045557-cf9b-4a39-be84-c7f230640581 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:23.949483 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:23.950141 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:23.950339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:23.950630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:23.951269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:23.951559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:23.952916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:23.964473 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 417/837] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:23.970281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:24.043912 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:24.080634 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb0cc8-704b-4de5-a95a-c26fc945cb2b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:24.116040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:24.116736 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:24.117048 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:24.117328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:24.126955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:24.128667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:35:24.141147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:24.142276 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:24.143435 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 421/838] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:24.148783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:24.258167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb675e8-9e8a-43ef-9dbe-f8f8499a20cf None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:24.277185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:24.295345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:24.295961 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:24.296234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:24.296504 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:24.297204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:24.297500 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:24.298971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d44eeb-8af0-44fa-93b4-8f7f465e8244 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:24.311274 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 418/839] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:24.318134 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:24.428432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466813d-65f7-47ae-88ad-cfed272c6d7a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:24.460409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:24.467710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:24.468320 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:24.468595 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:24.468862 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:24.469586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=854747c422b8470bbb434bdf95cc791a) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:24.469886 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:24.471369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691402f2-f19f-4eef-a8f0-43b99f72b9fa None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:24.476895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 422/840] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:35:24 2022] GET /identity/v3/role_assignments?user.id=854747c422b8470bbb434bdf95cc791a&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:35:26.646753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc39e-78c8-48ed-82fc-5498a0ba541b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:26.647328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc39e-78c8-48ed-82fc-5498a0ba541b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:26.647328 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbc39e-78c8-48ed-82fc-5498a0ba541b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:26.648620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 419/841] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:26.653980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:26.654393 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:26.654559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:26.673115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:26.674300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:26.750622 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 423/842] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 20:35:27.073672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc39e-78c8-48ed-82fc-5498a0ba541b None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:27.193175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbc39e-78c8-48ed-82fc-5498a0ba541b None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:27.231187 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:27.231854 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:27.232247 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:27.232527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:27.245170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:35:27.251251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:27.252407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:27.253231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 420/843] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:35:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:27.258597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:27.367856 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa12c83-4fef-4b66-bb73-3f977bb85dbc None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:27.395680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:27.407366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:27.407979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:27.408250 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:27.408518 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:27.409155 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] RBAC: Adding query filter params (name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:27.409454 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:27.410848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:27.419041 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 424/844] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:27.424889 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:27.468687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:27.532963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795033-24da-431c-84a1-9134fe362e74 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:27.567861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:27.568490 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:27.568766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:27.569027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:27.579158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:27.580662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:27.596792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:27.597976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:27.599078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:27.599078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:27.599078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:27.599078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 421/845] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:27.604762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:27.720988 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411336b7-81f3-4368-b318-dc88645695ef None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:27.766497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:27.766497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:27.766497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:27.766497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:27.766943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:27.766943 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:27.768002 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:27.780878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 425/846] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:27.788613 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:27.885149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:27.895364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a929d2-c02b-4632-85ce-03249d8d79b7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:27.930813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:27.931443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:27.931721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:27.931991 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:27.940138 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:27.941625 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:35:27.952930 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:27.958545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:27.959696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 422/847] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:27.960630 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:28.009663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:28.062826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b4cd-8ca6-494f-b250-d6fbfffd3134 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:28.096674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:28.097318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:28.097591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:28.097856 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:28.098718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:28.099015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:28.100497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:28.118534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 426/848] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 27 20:35:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:28.124553 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:28.236311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ddbd9-da8b-43c0-8f40-f25f02bbc7ab None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:28.276127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:28.276413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:28.276691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:28.276958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:28.292362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:28.294072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:28.309992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:28.311179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:28.312232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:28.312232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:28.312232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:28.317676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 423/849] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:28.317794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:28.427905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3a09-0c0e-48fb-a2f0-85195c9e32c0 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:28.430468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:28.469790 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:28.470407 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:28.470676 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:28.470940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:28.471586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:28.471921 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:28.473283 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:28.484930 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 427/850] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:28.490560 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:28.493717 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:28.613088 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f6fd-9ffc-4728-9058-33e248807506 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:28.647187 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:28.647890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:28.648575 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:28.648942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:28.655675 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:28.657145 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:35:28.668761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:28.670388 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:28.671570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 424/851] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:35:28.675752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:28.776001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca854ce1-152c-4774-b7fc-3813e3757e5f None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:28.818190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:28.818817 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:28.819089 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:28.819354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:28.820044 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:28.820338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:28.821773 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061452a-7b20-4b46-8217-189f7341d7c8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:28.843376 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 428/852] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:35:28.851690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:28.917189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:28.958882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45254d63-96ae-4737-85f6-d651a959c44c None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:28.993892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217e333-dc0f-4716-aa3e-31a0adbe1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:28.994569 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217e333-dc0f-4716-aa3e-31a0adbe1f39 None admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:28.994848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217e333-dc0f-4716-aa3e-31a0adbe1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:28.995118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217e333-dc0f-4716-aa3e-31a0adbe1f39 None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/854747c422b8470bbb434bdf95cc791a/roles/aea049c3ffe34aa5852e29c85044a538` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:29.009443 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217e333-dc0f-4716-aa3e-31a0adbe1f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=854747c422b8470bbb434bdf95cc791a, role_id=aea049c3ffe34aa5852e29c85044a538)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:29.010929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217e333-dc0f-4716-aa3e-31a0adbe1f39 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:29.023925 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 425/853] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:35:28 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/854747c422b8470bbb434bdf95cc791a/roles/aea049c3ffe34aa5852e29c85044a538 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:35:31.163594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a51ae9-54de-47c6-91d5-c5479d93e2fe None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:31.164117 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a51ae9-54de-47c6-91d5-c5479d93e2fe None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:31.164117 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a51ae9-54de-47c6-91d5-c5479d93e2fe None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:31.165371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 429/854] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:31.170834 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:31.171401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:31.171401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:31.189239 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:31.190486 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:31.266651 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 426/855] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:31.597357 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a51ae9-54de-47c6-91d5-c5479d93e2fe None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:31.629662 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:31.716001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a51ae9-54de-47c6-91d5-c5479d93e2fe None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:31.752464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:31.753123 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:31.753402 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:31.753691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:31.764643 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:35:31.769594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:31.770734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:31.771605 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 430/856] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 27 20:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:31.777026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:31.823548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:31.882791 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4134e-aea6-4a8b-a6f1-6be79695e3fa None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:31.921383 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:31.922007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:31.922356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:31.922712 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:31.923558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:31.923936 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:31.925699 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:31.939833 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 427/857] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 27 20:35:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:31.941135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:32.036140 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:32.051489 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f69a6d-90e4-4be7-802a-e08f42c05f75 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:32.086881 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:32.087893 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:32.088197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:32.088497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:32.100410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:32.102139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:32.118523 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:32.119543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:32.120469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:32.120469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:32.120469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:32.120469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 431/858] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:35:32.125576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:32.231249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad950-1aec-4491-8a24-6e3a11e6b2f1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:32.233821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:32.267865 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:32.268478 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:32.268797 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:32.269069 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:32.269755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:32.270022 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:32.271482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:32.284271 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 428/859] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:35:32.290097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:32.401442 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9626-5901-40a7-8a5d-41240c28c345 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:32.443144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:32.443787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:32.444322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:32.444730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:32.449231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:32.456195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:32.457840 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:35:32.471193 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:32.473139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:32.474124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 432/860] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:32.478609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:32.592064 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af2e79-80eb-4cee-950a-45bd86b01a68 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:32.630600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:32.631201 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:32.631475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:32.631744 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:32.632515 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:32.632811 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:32.634265 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:32.652878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 429/861] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 27 20:35:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:32.658921 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:32.767127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1b44c-cbab-4bba-90bd-efe0961c1bd5 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:32.806999 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:32.807713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:32.808053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:32.808385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:32.875157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:32.883203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:32.884668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:32.987780 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 433/862] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:35:32 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 20:35:32.995040 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:33.022029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:33.102707 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59350e-488d-4af1-a9a2-dc3e12fa53d6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:33.137945 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:33.138617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:33.138860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:33.139121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:33.149503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:33.151074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:33.165779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:33.167004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:33.168131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:33.168131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:33.168131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:33.168131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 430/863] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:33.173103 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:33.278754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:33.285492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b29d6-1877-46e8-9ba0-393f49506268 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:33.325083 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:33.326092 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:33.326396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:33.326925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:33.327960 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:33.328456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:33.330559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:33.347381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 434/864] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:33.353260 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:33.442609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:33.475029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2d59-cebf-49b0-af0c-73da3517df08 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:33.511659 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:33.512319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:33.512600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:33.512870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:33.519435 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:33.520880 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:35:33.533008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:33.534192 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:33.535353 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 431/865] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:35:33.542146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:33.642838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d1f8f-25ec-4353-9b40-2aedb9ae80ab None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:33.683147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:33.684078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:33.684297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:33.684561 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:33.685767 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:33.686181 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:33.687655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df468dc-62c4-4b11-9cc3-490b960d4853 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:33.709565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 435/866] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:33.716170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:33.835364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3106a-67aa-4b21-8f10-2d94237c423d None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:33.873620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:33.874231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:33.874535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:33.874806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:33.875538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] RBAC: Adding query filter params (role.id=aea049c3ffe34aa5852e29c85044a538, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=854747c422b8470bbb434bdf95cc791a) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:33.875848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:33.877294 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1fa2c-9a66-4b00-8e83-cb869274872d None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:33.879221 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:33.885324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 432/867] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:35:33 2022] GET /identity/v3/role_assignments?user.id=854747c422b8470bbb434bdf95cc791a&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=aea049c3ffe34aa5852e29c85044a538 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:36.115271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770523-f8a8-4f92-ba8b-67835da95917 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:36.115819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770523-f8a8-4f92-ba8b-67835da95917 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:36.115819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770523-f8a8-4f92-ba8b-67835da95917 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:36.117324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 436/868] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:36.122885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:36.123397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:36.123397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:36.142679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:36.144000 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:36.222299 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 433/869] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:36 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:36.550766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770523-f8a8-4f92-ba8b-67835da95917 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:36.572229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:36.664927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770523-f8a8-4f92-ba8b-67835da95917 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:36.704207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:36.705115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:36.705433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:36.705889 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:36.717679 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:35:36.722823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:36.723878 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:36.724722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 437/870] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:36.730180 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:36.847927 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254de9e-0081-47db-b7d7-669805c71b90 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:36.874198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:36.884940 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:36.885588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:36.885868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:36.886137 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:36.886948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:36.887337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:36.889578 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:36.901931 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 434/871] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:36.907750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:36.993548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:37.022146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1518ca6-7237-4fa8-9879-89097fd9e69a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:37.057691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:37.058349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:37.058712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:37.059008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:37.069928 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:37.071486 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:37.088220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:37.089371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:37.090279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:37.090279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:37.090279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:37.090279 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 438/872] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:35:37.095679 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:37.203694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19426d3-d05c-42e2-80e8-838aefb32b38 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:37.240690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:37.241315 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:37.241591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:37.241861 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:37.242596 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:37.242900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:37.244322 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:37.256285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 435/873] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:37.262814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:37.364926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba90a0-1fe6-4d54-bf52-296aed78ce1c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:37.391848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:37.401113 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:37.401751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:37.402043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:37.402398 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:37.411996 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:37.413549 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:35:37.425493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:37.426657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:37.427652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:37.428240 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 439/874] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:37.434899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:37.498997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:37.554165 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7906f9d-c0c8-4b72-9043-2cb60eb8d4c8 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:37.588892 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:37.589591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:37.589914 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:37.590179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:37.591163 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:37.591527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:37.593094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:37.613533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 436/875] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 27 20:35:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:37.619468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:37.727670 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f29a-eec9-4cd2-8ca3-d360a29d7b87 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:37.772155 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:37.772734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:37.773012 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:37.773280 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:37.834646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:37.851226 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:37.853266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:37.969175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 440/876] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:35:37 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 20:35:37.975336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:38.082597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a94e7-d538-47d0-a6d0-e7dded000bee None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:38.095087 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:38.124809 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:38.125440 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:38.125728 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:38.125982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:38.136494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:38.137957 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:38.153878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:38.155007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:38.155981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:38.155981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:38.155981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:38.155981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 437/877] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:38.161007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:38.253539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:38.266345 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3636cc-f877-44e6-8df5-06fef21de33c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:38.304532 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:38.305139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:38.305410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:38.305675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:38.306357 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:38.306723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:38.308186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:38.320086 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 441/878] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:38.326001 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:38.439074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21499c59-2978-4d87-8a70-232e66d8d524 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:38.482956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:38.483721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:38.483979 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:38.484369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:38.493250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:38.494832 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:35:38.507489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:38.508527 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:38.509568 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 438/879] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:38.514995 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:38.623196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf008da-09a6-453a-bad3-0416694200da None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:38.661100 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:38.661723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:38.661994 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:38.662255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:38.663011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:38.663309 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:38.664802 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb64cf-3fae-48fb-ae77-b4e3581be8c8 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:38.678399 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 442/880] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:38.684945 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:38.710725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:38.796249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed367-64cd-4888-8e1e-a8aa73451df7 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:38.832186 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:38.832769 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:38.833041 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:38.833313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:38.834057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=854747c422b8470bbb434bdf95cc791a) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:38.834362 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:38.835859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cbc9f-1435-4af5-ad25-84fbc344c791 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:38.842207 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 439/881] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:35:38 2022] GET /identity/v3/role_assignments?user.id=854747c422b8470bbb434bdf95cc791a&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=0f13813da5a84a44829df58f1d837465 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:40.979723 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7622-3ec9-49b0-aa5b-f89b8ac445b9 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:40.980289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7622-3ec9-49b0-aa5b-f89b8ac445b9 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:40.980289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7622-3ec9-49b0-aa5b-f89b8ac445b9 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:40.981611 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 443/882] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:40.987004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:40.987431 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:40.987536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:41.007316 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:41.008487 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:41.076843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 440/883] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:41.401661 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf7622-3ec9-49b0-aa5b-f89b8ac445b9 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:41.419123 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:41.521695 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf7622-3ec9-49b0-aa5b-f89b8ac445b9 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:41.557282 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:41.557899 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:41.558173 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:41.558437 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:41.569100 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:35:41.573905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:41.575014 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:41.575865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 444/884] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:41.581497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:41.596992 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:41.686784 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e94820-d6bb-4697-b855-22a6033ccafd None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:41.723246 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:41.723866 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:41.724135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:41.724397 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:41.725050 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:41.725348 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:41.726721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:41.734782 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 441/885] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:41.741167 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:41.816796 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:41.851711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf613cc-5d99-4cb7-a80c-95d4845fe79b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:41.886287 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:41.886961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:41.887233 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:41.887509 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:41.901674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:41.904024 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:41.920554 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:41.921664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:41.922997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:41.922997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:41.922997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:41.922997 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 445/886] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:41.928248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:42.023670 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:42.048209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7b328-2830-4379-b7b2-14c447ca76f1 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:42.095060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:42.096654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:42.097373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:42.097862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:42.099077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:42.099591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:42.101222 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:42.115874 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 442/887] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:42.123059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:42.239170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce92c0-5b94-41d7-b182-de66fd807a2c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:42.258914 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:42.274104 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:42.274683 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:42.274966 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:42.275232 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] PATH_INFO: `/v3/users/placement` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:42.282743 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:42.284195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:35:42.295468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:42.296444 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:42.297441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 446/888] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:42.302611 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:42.407334 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09c7-71a0-4264-8335-109684d58f79 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:42.443367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:42.443986 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:42.444262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:42.444532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:42.445273 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:42.445576 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:42.447059 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:42.450898 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:42.468260 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 443/889] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 27 20:35:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:42.474386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:42.577311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca33ff6-a216-4974-a6ce-6df336f9c84a None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:42.612109 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:42.612747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:42.613017 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:42.613281 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:42.624771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:42.627013 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:42.642692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:42.643748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:42.644742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:42.644742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:42.644742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:42.644742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 447/890] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:42.649807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:42.760742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef984c9-7a8e-4abc-9262-20ba14c1a069 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:42.795006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:42.795593 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:42.795866 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:42.796127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:42.796760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:42.797050 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:42.798406 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:42.809118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 444/891] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:42.815214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:42.846940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:42.920521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ba28-3b2c-454c-986b-4d7e8eb8193b None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:42.954580 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:42.955201 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:42.955472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:42.955735 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:42.963409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:42.964858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:35:42.983814 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:42.984870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:42.985770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 448/892] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:42.991102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:43.046981 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:43.106305 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c7b4c-5b02-4a27-ba85-cf547f8320b0 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:43.140719 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:43.141363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:43.141637 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:43.141889 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:43.142689 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:43.142996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:43.144471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663c908-0032-4e32-9167-afac51c2ad41 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:43.156042 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 445/893] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:43.165874 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:43.268322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:43.278143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fcdd-9653-4a12-a843-bb1fe9dc066c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:43.312253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfb764-7659-4faf-844b-ddf29b16df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:43.312884 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb764-7659-4faf-844b-ddf29b16df70 None admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:43.313157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb764-7659-4faf-844b-ddf29b16df70 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:43.313421 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfb764-7659-4faf-844b-ddf29b16df70 None admin] PATH_INFO: `/v3/projects/f613b43f593f478195796a930df05d6c/users/854747c422b8470bbb434bdf95cc791a/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:43.315445 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfb764-7659-4faf-844b-ddf29b16df70 None admin] RBAC: Authorizing `identity:create_grant(project_id=f613b43f593f478195796a930df05d6c, user_id=854747c422b8470bbb434bdf95cc791a, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:43.316941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfb764-7659-4faf-844b-ddf29b16df70 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:43.332006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 449/894] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 27 20:35:43 2022] PUT /identity/v3/projects/f613b43f593f478195796a930df05d6c/users/854747c422b8470bbb434bdf95cc791a/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:35:45.441365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e7f0f-4421-4ee2-9b65-293c19cdc572 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:45.441936 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e7f0f-4421-4ee2-9b65-293c19cdc572 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:45.441936 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e7f0f-4421-4ee2-9b65-293c19cdc572 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:45.443439 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 446/895] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:35:45.451483 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:45.452418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:45.452993 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:45.480610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:45.482363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:45.552676 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 450/896] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:45 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:45.881037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e7f0f-4421-4ee2-9b65-293c19cdc572 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:45.990965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e7f0f-4421-4ee2-9b65-293c19cdc572 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:46.007204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:46.030932 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:46.031554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:46.031826 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:46.032098 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:46.042587 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 20:35:46.047394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:46.048497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:46.049533 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 447/897] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 27 20:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 20:35:46.054915 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:46.138675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:46.161253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a4898-21ec-4cdf-b2d0-244a885ddf1c None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:46.197350 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:46.197953 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:46.198231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:46.198491 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:46.199194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] RBAC: Adding query filter params (name=admin) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:46.199497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:46.200872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:46.209495 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 451/898] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 27 20:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:46.216265 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:46.321404 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7045ce-7558-45ca-a907-c480f6fd49c4 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:46.360908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:46.361513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:46.361792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:46.362057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:46.372343 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:46.373795 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:46.388644 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:46.389727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:46.390700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:46.390700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:46.390700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:46.390700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 448/899] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:46.395543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:46.505608 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ed823-6bd8-4a25-a3ed-a6f5c602905c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:46.541921 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be1f57-9364-4e63-93db-996478898404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:46.542571 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be1f57-9364-4e63-93db-996478898404 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:46.542846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be1f57-9364-4e63-93db-996478898404 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:46.543115 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be1f57-9364-4e63-93db-996478898404 None admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:46.543756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be1f57-9364-4e63-93db-996478898404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:46.544056 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be1f57-9364-4e63-93db-996478898404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:46.545425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be1f57-9364-4e63-93db-996478898404 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:46.558732 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 452/900] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:35:46.567905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:46.597832 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:46.671586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0890af-8184-41fa-936d-c5f06aa40531 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:46.706300 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:46.706956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:46.707231 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:46.707494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:46.715366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:46.716794 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 20:35:46.728139 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:46.729198 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:46.730415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 449/901] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:46.735386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be1f57-9364-4e63-93db-996478898404 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:46.739286 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:46.845972 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be1f57-9364-4e63-93db-996478898404 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:46.882385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:46.883025 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:46.883300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:46.883572 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:46.884301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:46.884596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:46.886047 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:46.906505 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 453/902] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 27 20:35:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:46.915582 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:47.014847 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:47.030809 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b48763-d583-4b64-ae5b-bc2aebac1dcd None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:47.065536 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:47.066125 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:47.066398 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:47.066697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:47.135067 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:47.136520 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:47.223267 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:47.240819 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 450/903] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 27 20:35:46 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 20:35:47.246888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:47.308719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:47.357759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae342e4-5ff9-43c0-93d1-4db593ec6d7c None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:47.392877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:47.393491 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:47.393763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:47.394030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:47.404542 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:47.405982 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 20:35:47.420706 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:47.421742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 20:35:47.422778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 20:35:47.422778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 20:35:47.422778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:47.422778 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 454/904] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:47.428290 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:47.532324 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b26cb3-6ea3-405d-8e03-8f84ce022eb6 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:47.571927 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:47.572505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:47.572705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:47.572965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:47.573603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:47.573895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:47.575293 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:47.587237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 451/905] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 27 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:47.594405 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:47.716251 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda499ea-ae73-4899-890b-cc83edf44332 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:47.731156 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:47.754015 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:47.754645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:47.754917 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:47.755191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:47.761844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:47.763313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 20:35:47.774553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:47.775521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: ERROR keystone.server.flask.application Aug 27 20:35:47.776713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 455/906] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 27 20:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:47.781608 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:47.828473 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:47.894478 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ff9bf-5627-4731-b326-457acf06f05f None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:47.930474 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:47.931074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:47.931345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:47.931614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:47.932311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:47.932617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:47.934064 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd9107-8a0e-4b30-9e48-d7728c220332 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:47.946141 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 452/907] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 27 20:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:47.952653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:48.058632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670bfb5-eca4-44fe-bf07-4a6a54ccf144 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:48.093736 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:48.094249 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:48.094550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:48.094811 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:48.095522 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] RBAC: Adding query filter params (role.id=0f13813da5a84a44829df58f1d837465, scope.project.id=f613b43f593f478195796a930df05d6c, user.id=854747c422b8470bbb434bdf95cc791a) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:48.095820 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:48.097236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1f252-1ad4-4584-bb71-5781b757e4d6 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:48.103029 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 456/908] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 27 20:35:47 2022] GET /identity/v3/role_assignments?user.id=854747c422b8470bbb434bdf95cc791a&scope.project.id=f613b43f593f478195796a930df05d6c&role.id=0f13813da5a84a44829df58f1d837465 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:50.300873 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3615-9126-4f63-b23d-4dc6147d4ca6 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:50.301810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3615-9126-4f63-b23d-4dc6147d4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:50.301810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3615-9126-4f63-b23d-4dc6147d4ca6 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:50.303993 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 453/909] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:50.311915 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19381-7d78-4212-b875-327276368b4d None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:50.312373 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19381-7d78-4212-b875-327276368b4d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:50.312462 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19381-7d78-4212-b875-327276368b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:50.332687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-56e19381-7d78-4212-b875-327276368b4d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:50.333879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-56e19381-7d78-4212-b875-327276368b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:50.364771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:50.403617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 457/910] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 20:35:50.750325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3615-9126-4f63-b23d-4dc6147d4ca6 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:50.859060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3615-9126-4f63-b23d-4dc6147d4ca6 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:50.866073 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:50.898874 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:50.899505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:50.899774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:50.900037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:50.900626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:50.901982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:50.910761 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:50.914705 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:50.915755 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 454/911] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 27 20:35:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:50.917966 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19381-7d78-4212-b875-327276368b4d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:51.028114 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19381-7d78-4212-b875-327276368b4d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:51.064834 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:51.065411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:51.065705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:51.066030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:51.066820 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:51.067120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:51.068530 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f364567-5fd3-4e12-855f-5bfbb7a86ef4 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:51.073485 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 458/912] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 27 20:35:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:51.079434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:51.181528 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829de68-8488-4ac6-b264-266ce19b6957 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:51.219826 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:51.220415 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:51.220691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:51.220967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] PATH_INFO: `/v3/services` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:51.221604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:51.221904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:51.223392 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74f623-2ab1-4933-919f-ce7bb9a7f3c9 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:51.228036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 455/913] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 27 20:35:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:53.377736 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fa026-fab2-4b4c-a2c6-fc3791540b9d None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:53.378322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fa026-fab2-4b4c-a2c6-fc3791540b9d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:53.378322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fa026-fab2-4b4c-a2c6-fc3791540b9d None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:53.380006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 459/914] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:53.386108 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a4a9-1fab-4af3-a4d1-1c6b789ab2b1 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:53.386606 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a4a9-1fab-4af3-a4d1-1c6b789ab2b1 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:53.386697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a4a9-1fab-4af3-a4d1-1c6b789ab2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:53.413629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-8526a4a9-1fab-4af3-a4d1-1c6b789ab2b1 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:53.414849 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-8526a4a9-1fab-4af3-a4d1-1c6b789ab2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:53.444931 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:53.490682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 456/915] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:53.813665 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fa026-fab2-4b4c-a2c6-fc3791540b9d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:53.848711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:53.931928 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fa026-fab2-4b4c-a2c6-fc3791540b9d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:53.976809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33d6d8-7129-4c89-8bdd-9530b5484bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:53.977525 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d6d8-7129-4c89-8bdd-9530b5484bd2 None admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:53.977804 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d6d8-7129-4c89-8bdd-9530b5484bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:53.978065 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33d6d8-7129-4c89-8bdd-9530b5484bd2 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:53.978750 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d6d8-7129-4c89-8bdd-9530b5484bd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:53.980121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33d6d8-7129-4c89-8bdd-9530b5484bd2 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:53.998228 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 460/916] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 27 20:35:53 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:35:56.131768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6f5d0-0b8a-4123-9803-82207ad49d08 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:56.132594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6f5d0-0b8a-4123-9803-82207ad49d08 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:56.132594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6f5d0-0b8a-4123-9803-82207ad49d08 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:56.134764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 457/917] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:56.143639 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:56.144145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:56.144280 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:56.163952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:56.165070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:56.251949 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 461/918] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:56 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:56.579370 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6f5d0-0b8a-4123-9803-82207ad49d08 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:56.684503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6f5d0-0b8a-4123-9803-82207ad49d08 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:56.719451 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:56.720064 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:56.720336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:56.720602 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:56.721167 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:56.722640 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:56.731442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:56.732545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:56.733505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:56.734624 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 458/919] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 27 20:35:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:56.738626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:56.759620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:56.845829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841637d9-d2cd-4a2c-8d2c-049aaa0917d1 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:56.880606 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:56.881235 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:56.881493 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:56.881755 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:56.882383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:56.882714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:56.884091 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:56.889719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 462/920] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 27 20:35:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:56.896234 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:56.934017 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:57.007159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf054a1-0b96-4c9b-83d8-57f64f3e9864 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:57.043971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:57.044559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:57.044831 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:57.045092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:57.045788 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] RBAC: Adding query filter params (interface=public, service_id=62f59aea5b8a4a05b7327996eb5c5d41, region_id=RegionOne) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:35:57.046091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:57.047482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414d9c-c4f8-4746-95d4-be7201981615 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:57.052947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 459/921] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 27 20:35:56 2022] GET /identity/v3/endpoints?service_id=62f59aea5b8a4a05b7327996eb5c5d41&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:35:57.062157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:57.153714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:57.174926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8df8cf-c21f-4faf-8f40-370b5f6aa674 None admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:57.211924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a7b05-e89b-4162-ad7b-0ca5ac9e1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:57.212509 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7b05-e89b-4162-ad7b-0ca5ac9e1c02 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:57.212783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7b05-e89b-4162-ad7b-0ca5ac9e1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:57.213368 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a7b05-e89b-4162-ad7b-0ca5ac9e1c02 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:57.213969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a7b05-e89b-4162-ad7b-0ca5ac9e1c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:57.215366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a7b05-e89b-4162-ad7b-0ca5ac9e1c02 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:57.221906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 463/922] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 27 20:35:57 2022] GET /identity/v3/services => generated 1962 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:35:59.364715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45cc8-0fc9-4407-b99e-edd9104b3fa7 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:59.365319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45cc8-0fc9-4407-b99e-edd9104b3fa7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:59.365319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45cc8-0fc9-4407-b99e-edd9104b3fa7 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:59.366629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 460/923] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:35:59.373135 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:59.373871 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:59.374020 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:59.394504 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:35:59.395707 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:35:59.464946 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 464/924] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:35:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 20:35:59.790919 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45cc8-0fc9-4407-b99e-edd9104b3fa7 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:35:59.903337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:35:59.918507 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45cc8-0fc9-4407-b99e-edd9104b3fa7 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:35:59.955142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:35:59.955769 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:35:59.956042 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:35:59.956307 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:35:59.956995 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:35:59.958372 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 20:35:59.967871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 20:35:59.969015 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application with Lock( Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self._enter() Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application return self.creator() Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application created_value = creator( Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: ERROR keystone.server.flask.application Aug 27 20:35:59.970032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 461/925] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 27 20:35:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 20:35:59.975326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:36:00.055368 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:36:00.080877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6e80-aa39-4d01-982c-08c877611393 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:36:00.121620 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:36:00.122487 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:36:00.122819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:36:00.123142 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] PATH_INFO: `/v3/services` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:36:00.124072 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:36:00.124459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:36:00.126559 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2d7c9-1be9-4135-8303-2d5d21959fc5 None admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:36:00.132845 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 465/926] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 27 20:35:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:36:00.138842 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:36:00.245141 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca1c6f-597c-4aeb-b37d-0226daa161e5 None admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:36:00.280182 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c2a34-345e-4024-ba50-d69c28b241fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:36:00.280752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c2a34-345e-4024-ba50-d69c28b241fd None admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:36:00.281029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c2a34-345e-4024-ba50-d69c28b241fd None admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:36:00.281299 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c2a34-345e-4024-ba50-d69c28b241fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:36:00.281965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c2a34-345e-4024-ba50-d69c28b241fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:36:00.283368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c2a34-345e-4024-ba50-d69c28b241fd None admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:36:00.307429 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 462/927] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:36:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:36:10.129551 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=30 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:36:10.302539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:36:59.790900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257ea3a-3c2a-43e4-b236-be5d9adf0e4e None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:36:59.791406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257ea3a-3c2a-43e4-b236-be5d9adf0e4e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:36:59.791667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257ea3a-3c2a-43e4-b236-be5d9adf0e4e None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:36:59.797130 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 466/928] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:36:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:36:59.798424 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e937-5fbb-443b-be0f-2659176f21b2 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:36:59.798876 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e937-5fbb-443b-be0f-2659176f21b2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:36:59.798963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e937-5fbb-443b-be0f-2659176f21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:36:59.819891 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-83e4e937-5fbb-443b-be0f-2659176f21b2 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:36:59.821337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-83e4e937-5fbb-443b-be0f-2659176f21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:36:59.957617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 463/929] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:36:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:37:00.299217 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf602f-de82-4c8b-837e-afe76aa5b097 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:00.299543 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf602f-de82-4c8b-837e-afe76aa5b097 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:00.299919 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf602f-de82-4c8b-837e-afe76aa5b097 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:00.301865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 467/930] 10.222.0.15 () {54 vars in 965 bytes} [Sat Aug 27 20:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:00.308189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09688f-5f40-48b0-914e-9bee4cca39be None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:00.308728 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09688f-5f40-48b0-914e-9bee4cca39be None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:00.309149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09688f-5f40-48b0-914e-9bee4cca39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:00.395212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-7c09688f-5f40-48b0-914e-9bee4cca39be None None] MFA Rules not processed for user `df9d9d38efd14328b4d6230278a49fae`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:00.396799 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-7c09688f-5f40-48b0-914e-9bee4cca39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:00.462351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 464/931] 10.222.0.15 () {58 vars in 1062 bytes} [Sat Aug 27 20:37:00 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:00.471547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf602f-de82-4c8b-837e-afe76aa5b097 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:00.482850 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf602f-de82-4c8b-837e-afe76aa5b097 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:00.486730 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f1fc3-3c26-4038-9f34-c0c2b29343c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:00.487386 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f1fc3-3c26-4038-9f34-c0c2b29343c7 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:00.487659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f1fc3-3c26-4038-9f34-c0c2b29343c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:00.487953 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f1fc3-3c26-4038-9f34-c0c2b29343c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:00.497934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f1fc3-3c26-4038-9f34-c0c2b29343c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:00.499406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f1fc3-3c26-4038-9f34-c0c2b29343c7 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:00.509280 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 468/932] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:02.933673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311abd7-7e06-49d0-924e-fd5005d8cb87 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:02.934190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311abd7-7e06-49d0-924e-fd5005d8cb87 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:02.934190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311abd7-7e06-49d0-924e-fd5005d8cb87 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:02.935627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 465/933] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:02.940988 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74df418-a72e-4b04-9829-4b7e3af0fe1e None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:02.941426 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74df418-a72e-4b04-9829-4b7e3af0fe1e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:02.941512 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74df418-a72e-4b04-9829-4b7e3af0fe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:02.961203 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e74df418-a72e-4b04-9829-4b7e3af0fe1e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:02.962390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e74df418-a72e-4b04-9829-4b7e3af0fe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:02.970985 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 469/934] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:03.300655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311abd7-7e06-49d0-924e-fd5005d8cb87 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:03.313023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311abd7-7e06-49d0-924e-fd5005d8cb87 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:03.317123 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274a577-0775-40fe-aca6-818c936fe282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:03.317738 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a577-0775-40fe-aca6-818c936fe282 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:03.318006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a577-0775-40fe-aca6-818c936fe282 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:03.318264 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a577-0775-40fe-aca6-818c936fe282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:03.329037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274a577-0775-40fe-aca6-818c936fe282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:03.330540 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274a577-0775-40fe-aca6-818c936fe282 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:03.342298 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 466/935] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:05.805847 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9529d-65db-4509-a851-a89d72290610 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:05.806403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9529d-65db-4509-a851-a89d72290610 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:05.806403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9529d-65db-4509-a851-a89d72290610 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:05.807935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 470/936] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:37:05.813039 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b937-1a24-4baa-833a-1dc86ae2a109 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:05.813462 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b937-1a24-4baa-833a-1dc86ae2a109 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:05.813557 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b937-1a24-4baa-833a-1dc86ae2a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:05.851170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-9217b937-1a24-4baa-833a-1dc86ae2a109 None None] MFA Rules not processed for user `e41f3e4d789846bd8210f42df0a1bb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:05.852357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9217b937-1a24-4baa-833a-1dc86ae2a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:05.899627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:37:05.927956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 467/937] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:05 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:06.273313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735623-a2f3-400e-a960-306702f271b6 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:06.273602 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735623-a2f3-400e-a960-306702f271b6 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:06.274121 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735623-a2f3-400e-a960-306702f271b6 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:06.275775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 471/938] 10.222.0.15 () {54 vars in 965 bytes} [Sat Aug 27 20:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:06.281904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52ed1-4e6c-404b-b896-23cba58df884 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:06.282259 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52ed1-4e6c-404b-b896-23cba58df884 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:06.282617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52ed1-4e6c-404b-b896-23cba58df884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:06.302007 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-54c52ed1-4e6c-404b-b896-23cba58df884 None None] MFA Rules not processed for user `df9d9d38efd14328b4d6230278a49fae`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:06.303331 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-54c52ed1-4e6c-404b-b896-23cba58df884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:06.309897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 468/939] 10.222.0.15 () {58 vars in 1062 bytes} [Sat Aug 27 20:37:06 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:06.318657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1735623-a2f3-400e-a960-306702f271b6 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:06.330322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1735623-a2f3-400e-a960-306702f271b6 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:06.334363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96be2aa-6f5e-4aa0-9623-f87f58a1c3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:06.335199 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96be2aa-6f5e-4aa0-9623-f87f58a1c3bd service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:06.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96be2aa-6f5e-4aa0-9623-f87f58a1c3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:06.335872 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96be2aa-6f5e-4aa0-9623-f87f58a1c3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:06.346211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96be2aa-6f5e-4aa0-9623-f87f58a1c3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:06.347855 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96be2aa-6f5e-4aa0-9623-f87f58a1c3bd service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:06.357775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 472/940] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:06 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:37:09.437792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94705-d400-492c-a806-37ce13b7364b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:09.438860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94705-d400-492c-a806-37ce13b7364b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:09.438860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa94705-d400-492c-a806-37ce13b7364b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:09.440948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 469/941] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:09.446412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09f89-eb01-4de4-b759-1a1d49776442 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:09.446875 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09f89-eb01-4de4-b759-1a1d49776442 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:09.446990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09f89-eb01-4de4-b759-1a1d49776442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:09.466274 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-33f09f89-eb01-4de4-b759-1a1d49776442 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:09.467507 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-33f09f89-eb01-4de4-b759-1a1d49776442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:09.539496 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 473/942] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:09 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:09.892626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94705-d400-492c-a806-37ce13b7364b None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:09.910682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa94705-d400-492c-a806-37ce13b7364b None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:09.915060 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015bc77-ff7c-4dd6-8b4c-421fbf2ac173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:09.915657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015bc77-ff7c-4dd6-8b4c-421fbf2ac173 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:09.915931 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015bc77-ff7c-4dd6-8b4c-421fbf2ac173 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:09.916200 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015bc77-ff7c-4dd6-8b4c-421fbf2ac173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:09.925760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015bc77-ff7c-4dd6-8b4c-421fbf2ac173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:09.927245 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015bc77-ff7c-4dd6-8b4c-421fbf2ac173 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:09.936891 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 470/943] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:09 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:12.791479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515681ea-e8ee-4b75-9dd5-b39c79f6cac5 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:12.792107 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515681ea-e8ee-4b75-9dd5-b39c79f6cac5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:12.792107 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515681ea-e8ee-4b75-9dd5-b39c79f6cac5 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:12.793415 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 474/944] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:12.798754 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e034-4b15-413d-82d7-343e6d984d47 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:12.799207 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e034-4b15-413d-82d7-343e6d984d47 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:12.799299 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e034-4b15-413d-82d7-343e6d984d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:12.818744 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-dfd3e034-4b15-413d-82d7-343e6d984d47 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:12.819943 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-dfd3e034-4b15-413d-82d7-343e6d984d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:12.828117 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 471/945] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:13.165180 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515681ea-e8ee-4b75-9dd5-b39c79f6cac5 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:13.176597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515681ea-e8ee-4b75-9dd5-b39c79f6cac5 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:13.180406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce569cab-f0a1-40cb-ba83-6a48496e8cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:13.180991 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce569cab-f0a1-40cb-ba83-6a48496e8cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:13.181266 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce569cab-f0a1-40cb-ba83-6a48496e8cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:13.181534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce569cab-f0a1-40cb-ba83-6a48496e8cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:13.190760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce569cab-f0a1-40cb-ba83-6a48496e8cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:13.192160 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce569cab-f0a1-40cb-ba83-6a48496e8cd2 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:13.201597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 475/946] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:15.411027 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb8dd8-352b-4589-b483-5a39f44841e9 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:15.411572 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb8dd8-352b-4589-b483-5a39f44841e9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:15.411572 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb8dd8-352b-4589-b483-5a39f44841e9 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:15.412900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 472/947] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:15.418237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560d4c7-6003-4e9b-b31a-118ed87338c8 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:15.418718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560d4c7-6003-4e9b-b31a-118ed87338c8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:15.418907 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560d4c7-6003-4e9b-b31a-118ed87338c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:15.438858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-8560d4c7-6003-4e9b-b31a-118ed87338c8 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:15.440055 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-8560d4c7-6003-4e9b-b31a-118ed87338c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:15.448811 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 476/948] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:15.782909 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb8dd8-352b-4589-b483-5a39f44841e9 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:15.794575 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb8dd8-352b-4589-b483-5a39f44841e9 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:15.798165 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b83431-671b-44da-902d-9ed935d9de39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:15.798813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b83431-671b-44da-902d-9ed935d9de39 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:15.799081 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b83431-671b-44da-902d-9ed935d9de39 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:15.799347 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b83431-671b-44da-902d-9ed935d9de39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:15.808118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b83431-671b-44da-902d-9ed935d9de39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:15.809549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b83431-671b-44da-902d-9ed935d9de39 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:15.818975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 473/949] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:37:18.022793 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40124-ce0e-41ac-a347-627fa8ee910a None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:18.023381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40124-ce0e-41ac-a347-627fa8ee910a None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:18.023381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40124-ce0e-41ac-a347-627fa8ee910a None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:18.024705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 477/950] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:18.030095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f384a7-9d05-4743-8837-5a1c245833bb None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:18.030584 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f384a7-9d05-4743-8837-5a1c245833bb None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:18.030687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f384a7-9d05-4743-8837-5a1c245833bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:18.051142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-09f384a7-9d05-4743-8837-5a1c245833bb None None] MFA Rules not processed for user `e41f3e4d789846bd8210f42df0a1bb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:18.052355 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-09f384a7-9d05-4743-8837-5a1c245833bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:18.061086 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 474/951] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:18 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:18.394127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b40124-ce0e-41ac-a347-627fa8ee910a None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:18.406460 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b40124-ce0e-41ac-a347-627fa8ee910a None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:18.410472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af0778-3374-4cff-bb7e-9d214b0c1169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:18.411066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0778-3374-4cff-bb7e-9d214b0c1169 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:18.411341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0778-3374-4cff-bb7e-9d214b0c1169 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:18.411610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af0778-3374-4cff-bb7e-9d214b0c1169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:18.420722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af0778-3374-4cff-bb7e-9d214b0c1169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:18.422161 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af0778-3374-4cff-bb7e-9d214b0c1169 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:18.431759 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 478/952] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:18 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:20.820748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c248-deef-4760-b14f-1e9f30cd97f7 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:20.821309 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c248-deef-4760-b14f-1e9f30cd97f7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:20.821309 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c248-deef-4760-b14f-1e9f30cd97f7 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:20.822513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 475/953] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:20.828132 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327740c7-646a-4dba-8ab2-8785471d0631 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:20.828636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327740c7-646a-4dba-8ab2-8785471d0631 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:20.828636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327740c7-646a-4dba-8ab2-8785471d0631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:20.849152 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-327740c7-646a-4dba-8ab2-8785471d0631 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:20.850352 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-327740c7-646a-4dba-8ab2-8785471d0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:20.859125 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 479/954] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:21.186745 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c248-deef-4760-b14f-1e9f30cd97f7 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:21.198942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c248-deef-4760-b14f-1e9f30cd97f7 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:21.202757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e22a-d199-4151-a394-e5f718b0ab11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:21.203345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e22a-d199-4151-a394-e5f718b0ab11 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:21.203614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e22a-d199-4151-a394-e5f718b0ab11 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:21.203876 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e22a-d199-4151-a394-e5f718b0ab11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:21.212801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e22a-d199-4151-a394-e5f718b0ab11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:21.214224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e22a-d199-4151-a394-e5f718b0ab11 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:21.223946 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 476/955] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:23.439377 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728f203-80c3-49e1-bfe2-83cd2473fa73 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:23.439956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728f203-80c3-49e1-bfe2-83cd2473fa73 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:23.439956 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728f203-80c3-49e1-bfe2-83cd2473fa73 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:23.441308 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 480/956] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:23.446844 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2ef9-f7a5-4d1d-96f5-57d55cf2689e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:23.447235 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2ef9-f7a5-4d1d-96f5-57d55cf2689e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:23.447429 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f2ef9-f7a5-4d1d-96f5-57d55cf2689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:23.467020 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-8d6f2ef9-f7a5-4d1d-96f5-57d55cf2689e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:23.468230 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-8d6f2ef9-f7a5-4d1d-96f5-57d55cf2689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:23.476796 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 477/957] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:23.819436 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728f203-80c3-49e1-bfe2-83cd2473fa73 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:23.830791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728f203-80c3-49e1-bfe2-83cd2473fa73 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:23.834694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7414c-1d7b-40dd-aacb-2a1fa406a729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:23.835291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7414c-1d7b-40dd-aacb-2a1fa406a729 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:23.835560 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7414c-1d7b-40dd-aacb-2a1fa406a729 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:23.835824 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7414c-1d7b-40dd-aacb-2a1fa406a729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:23.845245 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7414c-1d7b-40dd-aacb-2a1fa406a729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:23.846792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7414c-1d7b-40dd-aacb-2a1fa406a729 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:23.856924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 481/958] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:26.488914 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773c4f-1767-45c4-8a4f-eaf9fab409db None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:26.489501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773c4f-1767-45c4-8a4f-eaf9fab409db None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:26.489501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37773c4f-1767-45c4-8a4f-eaf9fab409db None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:26.491639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 478/959] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:26.500544 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6692ac-6591-4431-ae81-9ac96ac4f819 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:26.500944 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6692ac-6591-4431-ae81-9ac96ac4f819 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:26.501155 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6692ac-6591-4431-ae81-9ac96ac4f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:26.522403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-df6692ac-6591-4431-ae81-9ac96ac4f819 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:26.523657 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-df6692ac-6591-4431-ae81-9ac96ac4f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:26.532644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 482/960] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:26 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:26.876049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37773c4f-1767-45c4-8a4f-eaf9fab409db None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:26.894903 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37773c4f-1767-45c4-8a4f-eaf9fab409db None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:26.899427 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ee01a-dd74-4637-9fd8-eb884ed84c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:26.900023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee01a-dd74-4637-9fd8-eb884ed84c65 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:26.900293 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee01a-dd74-4637-9fd8-eb884ed84c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:26.900547 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ee01a-dd74-4637-9fd8-eb884ed84c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:26.910652 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee01a-dd74-4637-9fd8-eb884ed84c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:26.912077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ee01a-dd74-4637-9fd8-eb884ed84c65 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:26.921650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 479/961] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:26 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:31.161416 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddf512-a067-42f1-bac6-9011d0706d53 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:31.161926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddf512-a067-42f1-bac6-9011d0706d53 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:31.161926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddf512-a067-42f1-bac6-9011d0706d53 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:31.163306 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 483/962] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:31.168552 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf001-d5b4-4fe6-8c2e-5f8934662a2e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:31.168996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf001-d5b4-4fe6-8c2e-5f8934662a2e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:31.169101 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf001-d5b4-4fe6-8c2e-5f8934662a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:31.188336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-414bf001-d5b4-4fe6-8c2e-5f8934662a2e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:31.189515 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-414bf001-d5b4-4fe6-8c2e-5f8934662a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:31.197790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 480/963] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:31.535163 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddf512-a067-42f1-bac6-9011d0706d53 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:31.541506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=74 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:37:31.548709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddf512-a067-42f1-bac6-9011d0706d53 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:31.552599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd1efe-4a83-44d4-8c06-96b6234b155e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:31.553206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1efe-4a83-44d4-8c06-96b6234b155e service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:31.553482 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1efe-4a83-44d4-8c06-96b6234b155e service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:31.553752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd1efe-4a83-44d4-8c06-96b6234b155e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:31.566702 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1efe-4a83-44d4-8c06-96b6234b155e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:31.568237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd1efe-4a83-44d4-8c06-96b6234b155e service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:31.577854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 484/964] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:34.334814 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64bdb3-5ef1-4af6-8888-f6b9213e4e75 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:34.335361 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64bdb3-5ef1-4af6-8888-f6b9213e4e75 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:34.335361 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64bdb3-5ef1-4af6-8888-f6b9213e4e75 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:34.336592 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 481/965] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:34.342174 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145719-ba4e-4453-81d8-8fc5c3f96618 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:34.342648 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145719-ba4e-4453-81d8-8fc5c3f96618 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:34.342744 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145719-ba4e-4453-81d8-8fc5c3f96618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:34.362009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2e145719-ba4e-4453-81d8-8fc5c3f96618 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:34.363300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2e145719-ba4e-4453-81d8-8fc5c3f96618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:34.371578 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 485/966] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:34 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:34.706283 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64bdb3-5ef1-4af6-8888-f6b9213e4e75 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:34.718048 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64bdb3-5ef1-4af6-8888-f6b9213e4e75 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:34.721874 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4049561-12d0-4243-b032-ef0d5c5d96bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:34.722487 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049561-12d0-4243-b032-ef0d5c5d96bc service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:34.722771 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049561-12d0-4243-b032-ef0d5c5d96bc service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:34.723040 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049561-12d0-4243-b032-ef0d5c5d96bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:34.732392 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4049561-12d0-4243-b032-ef0d5c5d96bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:34.733816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4049561-12d0-4243-b032-ef0d5c5d96bc service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:34.743350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 482/967] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:34 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:38.827980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c1047-b308-4986-9300-fcb4cc91c500 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:38.828432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c1047-b308-4986-9300-fcb4cc91c500 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:38.828520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c1047-b308-4986-9300-fcb4cc91c500 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:38.829876 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 486/968] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:38.835714 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac9567-fe52-4960-a0c4-370d270efae6 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:38.836114 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac9567-fe52-4960-a0c4-370d270efae6 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:38.836262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac9567-fe52-4960-a0c4-370d270efae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:38.844800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=57 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:37:38.857686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-a5ac9567-fe52-4960-a0c4-370d270efae6 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:38.858923 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-a5ac9567-fe52-4960-a0c4-370d270efae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:38.866973 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 483/969] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:39.206096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c1047-b308-4986-9300-fcb4cc91c500 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:39.218844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c1047-b308-4986-9300-fcb4cc91c500 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:39.223194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695ea7e-1d03-409c-8ae0-003a4e030b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:39.223792 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ea7e-1d03-409c-8ae0-003a4e030b68 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:39.224066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ea7e-1d03-409c-8ae0-003a4e030b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:39.224331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ea7e-1d03-409c-8ae0-003a4e030b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:39.233413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695ea7e-1d03-409c-8ae0-003a4e030b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:39.234893 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695ea7e-1d03-409c-8ae0-003a4e030b68 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:39.244338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 487/970] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:44.599985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ffc-acad-418e-ab61-f79399ffa1da None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:44.600525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ffc-acad-418e-ab61-f79399ffa1da None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:44.600525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0219ffc-acad-418e-ab61-f79399ffa1da None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:44.601965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 484/971] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:44.607219 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c639c-0a47-4f22-a662-63f2ba870acd None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:44.607981 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c639c-0a47-4f22-a662-63f2ba870acd None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:44.608389 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c639c-0a47-4f22-a662-63f2ba870acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:44.651108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-f30c639c-0a47-4f22-a662-63f2ba870acd None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:44.652537 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-f30c639c-0a47-4f22-a662-63f2ba870acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:44.743528 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 488/972] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:37:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:48.854069 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=2 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:37:49.386014 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3428d-a561-4aa9-8385-7c8759622648 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:49.386291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3428d-a561-4aa9-8385-7c8759622648 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:49.386591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3428d-a561-4aa9-8385-7c8759622648 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:49.388132 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 485/973] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:49.393009 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7164-6312-4795-97e4-ee3ccac52801 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:49.393819 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7164-6312-4795-97e4-ee3ccac52801 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:49.394270 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7164-6312-4795-97e4-ee3ccac52801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:49.415965 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-ff2a7164-6312-4795-97e4-ee3ccac52801 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:49.417625 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ff2a7164-6312-4795-97e4-ee3ccac52801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:49.428183 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 489/974] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:37:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:50.913768 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c1b1e-5970-4178-9a16-d3421ab3f0fe None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:50.914248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c1b1e-5970-4178-9a16-d3421ab3f0fe None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:50.914484 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c1b1e-5970-4178-9a16-d3421ab3f0fe None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:50.915916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 486/975] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:50.920950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5f7f-d7e6-43a8-9449-7493edd5c9f5 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:50.921336 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5f7f-d7e6-43a8-9449-7493edd5c9f5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:50.921506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5f7f-d7e6-43a8-9449-7493edd5c9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:50.941220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-e27d5f7f-d7e6-43a8-9449-7493edd5c9f5 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:50.942400 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-e27d5f7f-d7e6-43a8-9449-7493edd5c9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:50.951269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 490/976] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:37:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:37:54.789204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07a0d-939b-486c-9289-f99e44a2fbde None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:54.790074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07a0d-939b-486c-9289-f99e44a2fbde None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:54.790531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07a0d-939b-486c-9289-f99e44a2fbde None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:54.796308 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 487/977] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:54.797989 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfb18-55ce-4bb4-b6bf-d053ebb8dcbc None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:54.798427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfb18-55ce-4bb4-b6bf-d053ebb8dcbc None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:54.798619 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececfb18-55ce-4bb4-b6bf-d053ebb8dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:54.824610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-ececfb18-55ce-4bb4-b6bf-d053ebb8dcbc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:54.826237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ececfb18-55ce-4bb4-b6bf-d053ebb8dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:54.835950 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 491/978] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:55.191851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356e77-b574-4b84-9af5-da07a49c82f3 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:55.192795 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356e77-b574-4b84-9af5-da07a49c82f3 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:55.193721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b356e77-b574-4b84-9af5-da07a49c82f3 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:55.201544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 488/979] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 27 20:37:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:55.208920 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88565d-775e-4d8c-bbc4-44d6cce6388d None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:55.209348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88565d-775e-4d8c-bbc4-44d6cce6388d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:55.209753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88565d-775e-4d8c-bbc4-44d6cce6388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:55.258713 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-cd88565d-775e-4d8c-bbc4-44d6cce6388d None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:55.259902 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-cd88565d-775e-4d8c-bbc4-44d6cce6388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:55.327978 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:37:55.334289 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 492/980] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 27 20:37:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:37:55.342686 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356e77-b574-4b84-9af5-da07a49c82f3 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:55.358035 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b356e77-b574-4b84-9af5-da07a49c82f3 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:55.363904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bf1d8-bcca-4b70-a93a-7531265efeff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:55.364510 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bf1d8-bcca-4b70-a93a-7531265efeff service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:55.364881 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bf1d8-bcca-4b70-a93a-7531265efeff service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:55.365151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bf1d8-bcca-4b70-a93a-7531265efeff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:55.374079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bf1d8-bcca-4b70-a93a-7531265efeff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:55.375862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bf1d8-bcca-4b70-a93a-7531265efeff service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:55.386363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 489/981] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:37:57.778996 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79279b66-d688-4660-aeb6-6c8f8d9f7744 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:57.779591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79279b66-d688-4660-aeb6-6c8f8d9f7744 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:57.779591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79279b66-d688-4660-aeb6-6c8f8d9f7744 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:57.781059 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 493/982] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:37:57.786335 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facef90-8136-4443-a3b0-006641f31ece None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:57.786820 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facef90-8136-4443-a3b0-006641f31ece None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:57.786898 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facef90-8136-4443-a3b0-006641f31ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:57.806428 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-2facef90-8136-4443-a3b0-006641f31ece None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:37:57.807641 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-2facef90-8136-4443-a3b0-006641f31ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:37:57.816144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 490/983] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:37:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:37:58.165003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79279b66-d688-4660-aeb6-6c8f8d9f7744 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:37:58.180644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79279b66-d688-4660-aeb6-6c8f8d9f7744 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:37:58.185696 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c612d4-9fb4-49ed-ae44-dc0afc31c713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:37:58.186372 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c612d4-9fb4-49ed-ae44-dc0afc31c713 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:37:58.186751 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c612d4-9fb4-49ed-ae44-dc0afc31c713 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:37:58.187086 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c612d4-9fb4-49ed-ae44-dc0afc31c713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:37:58.196065 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c612d4-9fb4-49ed-ae44-dc0afc31c713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:37:58.197671 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c612d4-9fb4-49ed-ae44-dc0afc31c713 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:37:58.207656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 494/984] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:37:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:00.700171 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c16b5-5a99-4f8e-b323-2172adb9a6d7 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:00.700727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c16b5-5a99-4f8e-b323-2172adb9a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:00.700727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c16b5-5a99-4f8e-b323-2172adb9a6d7 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:00.702190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 491/985] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:00.707824 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891517-a59b-4a0a-b144-fa98e6d7a574 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:00.708246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891517-a59b-4a0a-b144-fa98e6d7a574 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:00.708360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891517-a59b-4a0a-b144-fa98e6d7a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:00.728145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-cf891517-a59b-4a0a-b144-fa98e6d7a574 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:00.729323 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-cf891517-a59b-4a0a-b144-fa98e6d7a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:00.738065 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 495/986] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:38:01.082924 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8e220-205a-4cc7-ae32-960a7d24fc83 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:01.083221 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8e220-205a-4cc7-ae32-960a7d24fc83 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:01.083489 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8e220-205a-4cc7-ae32-960a7d24fc83 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:01.084802 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 492/987] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 27 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:01.091926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d141d3-7ca1-4f5d-a515-67cac532d5c5 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:01.092204 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d141d3-7ca1-4f5d-a515-67cac532d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:01.092472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d141d3-7ca1-4f5d-a515-67cac532d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:01.113895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-d2d141d3-7ca1-4f5d-a515-67cac532d5c5 None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:01.115361 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-d2d141d3-7ca1-4f5d-a515-67cac532d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:01.124520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 496/988] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 27 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:01.133908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8e220-205a-4cc7-ae32-960a7d24fc83 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:01.147499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8e220-205a-4cc7-ae32-960a7d24fc83 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:01.152395 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848ad3f-162d-447c-80ec-212b60deb67f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:01.152997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ad3f-162d-447c-80ec-212b60deb67f service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:01.153281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ad3f-162d-447c-80ec-212b60deb67f service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:01.153556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848ad3f-162d-447c-80ec-212b60deb67f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:01.162326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848ad3f-162d-447c-80ec-212b60deb67f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:01.163973 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848ad3f-162d-447c-80ec-212b60deb67f service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:01.174209 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 493/989] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:03.433621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437f8f-06b3-4974-b173-5ac8bde471dc None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:03.435468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437f8f-06b3-4974-b173-5ac8bde471dc None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:03.436002 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437f8f-06b3-4974-b173-5ac8bde471dc None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:03.438100 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 497/990] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:03.445503 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf17d4-6e83-4828-8ead-4a3cd701cbfb None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:03.446655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf17d4-6e83-4828-8ead-4a3cd701cbfb None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:03.447179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf17d4-6e83-4828-8ead-4a3cd701cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:03.473097 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-3daf17d4-6e83-4828-8ead-4a3cd701cbfb None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:03.477151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-3daf17d4-6e83-4828-8ead-4a3cd701cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:03.495409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 494/991] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:03.858364 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7437f8f-06b3-4974-b173-5ac8bde471dc None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:03.873747 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7437f8f-06b3-4974-b173-5ac8bde471dc None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:03.879314 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88439055-f4d5-4897-a90c-62382c12daf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:03.880160 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88439055-f4d5-4897-a90c-62382c12daf5 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:03.880693 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88439055-f4d5-4897-a90c-62382c12daf5 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:03.881241 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88439055-f4d5-4897-a90c-62382c12daf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:03.903411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88439055-f4d5-4897-a90c-62382c12daf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:03.906644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88439055-f4d5-4897-a90c-62382c12daf5 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:03.918900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 498/992] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:05.000384 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01909d-f5db-443e-bddc-e4f335935b78 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:05.000829 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01909d-f5db-443e-bddc-e4f335935b78 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:05.001075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01909d-f5db-443e-bddc-e4f335935b78 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:05.002295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 495/993] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:05.012351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163e9b-d97d-44bc-80d1-7415d1f9462b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:05.012805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163e9b-d97d-44bc-80d1-7415d1f9462b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:05.013144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163e9b-d97d-44bc-80d1-7415d1f9462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:05.038013 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-4b163e9b-d97d-44bc-80d1-7415d1f9462b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:05.039674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-4b163e9b-d97d-44bc-80d1-7415d1f9462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:05.048696 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 499/994] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:05.654693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666576ca-d288-4f0c-bf4c-7a5f140efc38 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:05.655014 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666576ca-d288-4f0c-bf4c-7a5f140efc38 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:05.655213 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666576ca-d288-4f0c-bf4c-7a5f140efc38 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:05.656727 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 496/995] 10.222.0.15 () {54 vars in 964 bytes} [Sat Aug 27 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:05.661825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb09c-0337-49e1-9433-df96712b46f8 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:05.662069 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb09c-0337-49e1-9433-df96712b46f8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:05.662366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb09c-0337-49e1-9433-df96712b46f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:05.704126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-af4cb09c-0337-49e1-9433-df96712b46f8 None None] MFA Rules not processed for user `ed5cc105367448a59da0ce5cfe60e175`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:05.705749 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-af4cb09c-0337-49e1-9433-df96712b46f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:05.774855 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 500/996] 10.222.0.15 () {58 vars in 1061 bytes} [Sat Aug 27 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:05.782077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666576ca-d288-4f0c-bf4c-7a5f140efc38 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:05.793868 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666576ca-d288-4f0c-bf4c-7a5f140efc38 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:05.797453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92003896-a58f-46bd-9732-5b8203642cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5cc105367448a59da0ce5cfe60e175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:05.798052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003896-a58f-46bd-9732-5b8203642cad service cinder] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:05.798325 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003896-a58f-46bd-9732-5b8203642cad service cinder] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:05.798827 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92003896-a58f-46bd-9732-5b8203642cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:05.808629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003896-a58f-46bd-9732-5b8203642cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:05.810075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92003896-a58f-46bd-9732-5b8203642cad service cinder] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:05.819963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 497/997] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:38:06.306827 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7bfcb-23c4-4d0c-9d3c-7090079c2e70 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:06.307379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7bfcb-23c4-4d0c-9d3c-7090079c2e70 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:06.307379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7bfcb-23c4-4d0c-9d3c-7090079c2e70 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:06.308696 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 501/998] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:06.314989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432379d5-64b1-43f8-bd2d-6d7653da00a4 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:06.316046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432379d5-64b1-43f8-bd2d-6d7653da00a4 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:06.316339 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432379d5-64b1-43f8-bd2d-6d7653da00a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:06.342337 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-432379d5-64b1-43f8-bd2d-6d7653da00a4 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:06.343956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-432379d5-64b1-43f8-bd2d-6d7653da00a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:06.353032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 498/999] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:06.691613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7bfcb-23c4-4d0c-9d3c-7090079c2e70 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:06.705829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7bfcb-23c4-4d0c-9d3c-7090079c2e70 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:06.711331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd8639-ea2d-4cd4-819a-71e03c017bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:06.712007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8639-ea2d-4cd4-819a-71e03c017bec service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:06.712354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8639-ea2d-4cd4-819a-71e03c017bec service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:06.712691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd8639-ea2d-4cd4-819a-71e03c017bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:06.721691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd8639-ea2d-4cd4-819a-71e03c017bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:06.723387 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd8639-ea2d-4cd4-819a-71e03c017bec service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:06.744488 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 502/1000] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:08.943731 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa876ee-8212-4724-9d92-c029f3bba44f None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:08.944274 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa876ee-8212-4724-9d92-c029f3bba44f None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:08.944274 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa876ee-8212-4724-9d92-c029f3bba44f None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:08.945559 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 499/1001] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:08.950838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d90d-91be-4d35-9e42-b3e2dfcef0e9 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:08.951265 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d90d-91be-4d35-9e42-b3e2dfcef0e9 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:08.951354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867d90d-91be-4d35-9e42-b3e2dfcef0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:08.971586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-a867d90d-91be-4d35-9e42-b3e2dfcef0e9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:08.972784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-a867d90d-91be-4d35-9e42-b3e2dfcef0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:08.982232 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 503/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:09.327807 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa876ee-8212-4724-9d92-c029f3bba44f None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:09.343115 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa876ee-8212-4724-9d92-c029f3bba44f None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:09.348352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97f2a7-c384-44a9-91eb-82f00e2f50de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:09.348950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97f2a7-c384-44a9-91eb-82f00e2f50de service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:09.349218 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97f2a7-c384-44a9-91eb-82f00e2f50de service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:09.349479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97f2a7-c384-44a9-91eb-82f00e2f50de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:09.357647 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97f2a7-c384-44a9-91eb-82f00e2f50de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:09.359256 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97f2a7-c384-44a9-91eb-82f00e2f50de service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:09.368747 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 500/1003] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:11.564197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f976ca-b654-4bd4-8b09-11e9a96112e2 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:11.565680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f976ca-b654-4bd4-8b09-11e9a96112e2 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:11.566191 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f976ca-b654-4bd4-8b09-11e9a96112e2 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:11.575557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 504/1004] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:11 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:11.575921 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715eab1-bf78-4ef8-a1d8-bd8188cbdffd None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:11.576502 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715eab1-bf78-4ef8-a1d8-bd8188cbdffd None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:11.576502 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715eab1-bf78-4ef8-a1d8-bd8188cbdffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:11.598100 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-4715eab1-bf78-4ef8-a1d8-bd8188cbdffd None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:11.599382 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-4715eab1-bf78-4ef8-a1d8-bd8188cbdffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:11.607305 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 501/1005] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:38:11.957880 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f976ca-b654-4bd4-8b09-11e9a96112e2 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:11.972019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f976ca-b654-4bd4-8b09-11e9a96112e2 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:11.977634 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63906358-cef4-4a76-be4f-b0d7b5bc4400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:11.978232 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906358-cef4-4a76-be4f-b0d7b5bc4400 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:11.978535 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906358-cef4-4a76-be4f-b0d7b5bc4400 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:11.978810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63906358-cef4-4a76-be4f-b0d7b5bc4400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:11.987971 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63906358-cef4-4a76-be4f-b0d7b5bc4400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:11.989563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63906358-cef4-4a76-be4f-b0d7b5bc4400 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:11.999957 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 505/1006] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:14.195587 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f008c8c-f77d-4aa5-8468-7edfb75b573b None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:14.196322 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f008c8c-f77d-4aa5-8468-7edfb75b573b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:14.196322 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f008c8c-f77d-4aa5-8468-7edfb75b573b None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:14.197531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 502/1007] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:14.204130 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229535df-f49f-4ce1-9d24-a35e94bdd50c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:14.204576 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229535df-f49f-4ce1-9d24-a35e94bdd50c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:14.204808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229535df-f49f-4ce1-9d24-a35e94bdd50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:14.229118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-229535df-f49f-4ce1-9d24-a35e94bdd50c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:14.230736 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-229535df-f49f-4ce1-9d24-a35e94bdd50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:14.239418 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 506/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:14.589664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f008c8c-f77d-4aa5-8468-7edfb75b573b None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:14.607700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f008c8c-f77d-4aa5-8468-7edfb75b573b None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:14.614094 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fcaca-962f-4c8a-91a7-edbcb2d06407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:14.614956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fcaca-962f-4c8a-91a7-edbcb2d06407 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:14.615310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fcaca-962f-4c8a-91a7-edbcb2d06407 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:14.615655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fcaca-962f-4c8a-91a7-edbcb2d06407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:14.626266 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fcaca-962f-4c8a-91a7-edbcb2d06407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:14.628497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fcaca-962f-4c8a-91a7-edbcb2d06407 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:14.640804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 503/1009] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:17.200066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c2fd-716b-4eea-b506-67c0c3b80d07 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:17.200813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c2fd-716b-4eea-b506-67c0c3b80d07 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:17.200813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c2fd-716b-4eea-b506-67c0c3b80d07 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:17.202004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 507/1010] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:17.207997 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f701f-4bae-41cc-bd41-2cc4ff6e287e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:17.208495 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f701f-4bae-41cc-bd41-2cc4ff6e287e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:17.208725 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f701f-4bae-41cc-bd41-2cc4ff6e287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:17.233017 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-912f701f-4bae-41cc-bd41-2cc4ff6e287e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:17.234855 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-912f701f-4bae-41cc-bd41-2cc4ff6e287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:17.246538 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 504/1011] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:17.859040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c2fd-716b-4eea-b506-67c0c3b80d07 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:17.875553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c2fd-716b-4eea-b506-67c0c3b80d07 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:17.881764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a06add-28e6-46ab-9eca-178e18c21a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:17.882363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a06add-28e6-46ab-9eca-178e18c21a12 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:17.882642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a06add-28e6-46ab-9eca-178e18c21a12 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:17.882937 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a06add-28e6-46ab-9eca-178e18c21a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:17.892763 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a06add-28e6-46ab-9eca-178e18c21a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:17.894500 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a06add-28e6-46ab-9eca-178e18c21a12 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:17.904683 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 508/1012] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:20.551431 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66982755-a429-4888-b2a0-7b9c2526e3ae None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:20.552127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66982755-a429-4888-b2a0-7b9c2526e3ae None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:20.552127 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66982755-a429-4888-b2a0-7b9c2526e3ae None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:20.553235 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 505/1013] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:20.558701 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6c0ce-e597-4e62-b991-5c3f8eccdeb0 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:20.559196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6c0ce-e597-4e62-b991-5c3f8eccdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:20.559294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6c0ce-e597-4e62-b991-5c3f8eccdeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:20.579297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-dcb6c0ce-e597-4e62-b991-5c3f8eccdeb0 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:20.580519 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-dcb6c0ce-e597-4e62-b991-5c3f8eccdeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:20.588823 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 509/1014] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:20.929258 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66982755-a429-4888-b2a0-7b9c2526e3ae None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:20.937882 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=46 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:38:20.945519 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66982755-a429-4888-b2a0-7b9c2526e3ae None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:20.950586 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e65190-cc00-45a7-a27f-6f440882ad0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:20.951212 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e65190-cc00-45a7-a27f-6f440882ad0b service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:20.951479 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e65190-cc00-45a7-a27f-6f440882ad0b service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:20.951740 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e65190-cc00-45a7-a27f-6f440882ad0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:20.960100 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e65190-cc00-45a7-a27f-6f440882ad0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:20.961667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e65190-cc00-45a7-a27f-6f440882ad0b service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:20.971577 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 506/1015] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:21.695799 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1b3ba-9955-4f90-bf42-a4470d0e5b8f None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:21.696427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1b3ba-9955-4f90-bf42-a4470d0e5b8f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:21.696427 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1b3ba-9955-4f90-bf42-a4470d0e5b8f None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:21.697731 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 510/1016] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:21.703176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f3ae-06d9-4484-a085-e6fd5f4c72ea None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:21.703711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f3ae-06d9-4484-a085-e6fd5f4c72ea None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:21.703711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56f3ae-06d9-4484-a085-e6fd5f4c72ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:21.724693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-2a56f3ae-06d9-4484-a085-e6fd5f4c72ea None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:21.725912 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-2a56f3ae-06d9-4484-a085-e6fd5f4c72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:21.735067 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 507/1017] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:22.083844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1b89-7362-4069-bd15-5a1fc2a1f044 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:22.084208 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1b89-7362-4069-bd15-5a1fc2a1f044 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:22.084553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1b89-7362-4069-bd15-5a1fc2a1f044 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:22.086003 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 511/1018] 10.222.0.15 () {54 vars in 967 bytes} [Sat Aug 27 20:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:22.092160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751975-89c9-4fb4-bca0-78896d3c531a None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:22.092439 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751975-89c9-4fb4-bca0-78896d3c531a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:22.092707 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c751975-89c9-4fb4-bca0-78896d3c531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:22.132111 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-1c751975-89c9-4fb4-bca0-78896d3c531a None None] MFA Rules not processed for user `01102d0faa3845e0a76afc772579e808`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:22.133303 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-1c751975-89c9-4fb4-bca0-78896d3c531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:22.195444 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 508/1019] 10.222.0.15 () {58 vars in 1064 bytes} [Sat Aug 27 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:22.203050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1b89-7362-4069-bd15-5a1fc2a1f044 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:22.214317 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1b89-7362-4069-bd15-5a1fc2a1f044 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:22.218292 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d6542-b97f-4c09-8d57-b42c81b93067 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01102d0faa3845e0a76afc772579e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:22.218927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d6542-b97f-4c09-8d57-b42c81b93067 service glance] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:22.219205 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d6542-b97f-4c09-8d57-b42c81b93067 service glance] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:22.219475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d6542-b97f-4c09-8d57-b42c81b93067 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:22.228719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d6542-b97f-4c09-8d57-b42c81b93067 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:22.230169 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d6542-b97f-4c09-8d57-b42c81b93067 service glance] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:22.239534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 512/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:23.194037 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d61a9b-f478-4b7c-a001-f737d1bac051 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:23.194723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d61a9b-f478-4b7c-a001-f737d1bac051 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:23.194723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d61a9b-f478-4b7c-a001-f737d1bac051 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:23.196118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 509/1021] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:23.202366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36befea-43ab-4d80-bd02-31934acc0c63 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:23.203324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36befea-43ab-4d80-bd02-31934acc0c63 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:23.203562 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36befea-43ab-4d80-bd02-31934acc0c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:23.223831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c36befea-43ab-4d80-bd02-31934acc0c63 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:23.225052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c36befea-43ab-4d80-bd02-31934acc0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:23.237214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 513/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:38:23.591753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d61a9b-f478-4b7c-a001-f737d1bac051 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:23.606082 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d61a9b-f478-4b7c-a001-f737d1bac051 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:23.613554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801187d-5407-43fe-b1ec-10e52de48cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:23.614160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801187d-5407-43fe-b1ec-10e52de48cfb service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:23.614465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801187d-5407-43fe-b1ec-10e52de48cfb service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:23.614742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801187d-5407-43fe-b1ec-10e52de48cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:23.624913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801187d-5407-43fe-b1ec-10e52de48cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:23.626518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801187d-5407-43fe-b1ec-10e52de48cfb service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:23.636579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 510/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:38:25.940050 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4122-77ed-4646-a7a1-0cd767a33907 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:25.940708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4122-77ed-4646-a7a1-0cd767a33907 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:25.940708 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd4122-77ed-4646-a7a1-0cd767a33907 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:25.941948 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 514/1024] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:25.947564 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68ff62-14e8-4f3e-8ecf-e4c44a8277a9 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:25.948074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68ff62-14e8-4f3e-8ecf-e4c44a8277a9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:25.948074 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68ff62-14e8-4f3e-8ecf-e4c44a8277a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:25.969492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-3e68ff62-14e8-4f3e-8ecf-e4c44a8277a9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:25.971200 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-3e68ff62-14e8-4f3e-8ecf-e4c44a8277a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:25.979961 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 511/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:38:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:26.323711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4122-77ed-4646-a7a1-0cd767a33907 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:26.336580 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=92 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:38:26.344406 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd4122-77ed-4646-a7a1-0cd767a33907 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:26.352395 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811247d-d4f4-42e5-b940-53a0123bda67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:26.353097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811247d-d4f4-42e5-b940-53a0123bda67 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:26.353768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811247d-d4f4-42e5-b940-53a0123bda67 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:26.354370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811247d-d4f4-42e5-b940-53a0123bda67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:26.367011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811247d-d4f4-42e5-b940-53a0123bda67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:26.367011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811247d-d4f4-42e5-b940-53a0123bda67 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:26.375844 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 515/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:35.963870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=50 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:38:36.371136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=5 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:38:37.334149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eef3ff-ed8d-4779-ba29-8de7a95168d5 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:37.334783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eef3ff-ed8d-4779-ba29-8de7a95168d5 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:37.334783 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eef3ff-ed8d-4779-ba29-8de7a95168d5 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:37.336028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 512/1027] 10.222.0.15 () {54 vars in 918 bytes} [Sat Aug 27 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:37.341613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b149-79e6-49ed-be9d-fd8932deebf4 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:37.341888 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b149-79e6-49ed-be9d-fd8932deebf4 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:37.342155 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b149-79e6-49ed-be9d-fd8932deebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:37.362488 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-0014b149-79e6-49ed-be9d-fd8932deebf4 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:37.363725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-0014b149-79e6-49ed-be9d-fd8932deebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:37.372321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 516/1028] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Aug 27 20:38:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:37.386476 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75e72-d0ec-4635-8e34-ca4dfb2087f3 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:37.386864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75e72-d0ec-4635-8e34-ca4dfb2087f3 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:37.387134 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd75e72-d0ec-4635-8e34-ca4dfb2087f3 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:37.388445 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 513/1029] 10.222.0.15 () {54 vars in 918 bytes} [Sat Aug 27 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:37.393349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd5f3-99a3-469d-b28b-582ee29e83cd None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:37.393627 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd5f3-99a3-469d-b28b-582ee29e83cd None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:37.393892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dd5f3-99a3-469d-b28b-582ee29e83cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:37.413680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2e5dd5f3-99a3-469d-b28b-582ee29e83cd None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:37.414894 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2e5dd5f3-99a3-469d-b28b-582ee29e83cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:37.424127 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 517/1030] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Aug 27 20:38:37 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:40.091720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef8c7e-1ed6-4458-81c7-905b267a6c19 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:40.092341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef8c7e-1ed6-4458-81c7-905b267a6c19 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:40.092341 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef8c7e-1ed6-4458-81c7-905b267a6c19 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:40.093563 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:40.101443 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96afc-ad7e-4900-ad7f-d3d4ed5a6193 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:40.102197 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96afc-ad7e-4900-ad7f-d3d4ed5a6193 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:40.102366 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96afc-ad7e-4900-ad7f-d3d4ed5a6193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:40.132095 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-92e96afc-ad7e-4900-ad7f-d3d4ed5a6193 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:40.133293 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-92e96afc-ad7e-4900-ad7f-d3d4ed5a6193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:40.142817 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:38:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:40.487402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef8c7e-1ed6-4458-81c7-905b267a6c19 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:40.501938 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef8c7e-1ed6-4458-81c7-905b267a6c19 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:40.507723 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b128f-ee05-48b7-9821-679532af6402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:40.508311 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b128f-ee05-48b7-9821-679532af6402 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:40.508582 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b128f-ee05-48b7-9821-679532af6402 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:40.508846 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b128f-ee05-48b7-9821-679532af6402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:40.516817 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b128f-ee05-48b7-9821-679532af6402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:40.518482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b128f-ee05-48b7-9821-679532af6402 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:40.527878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 515/1033] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:41.474639 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1179-c70f-45a3-a1ad-2d22aa5e9455 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:41.475520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1179-c70f-45a3-a1ad-2d22aa5e9455 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:41.475520 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da1179-c70f-45a3-a1ad-2d22aa5e9455 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:41.477636 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:41.485002 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a855ca9-0eb2-4cb7-9536-0ba523de8a0d None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:41.485459 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a855ca9-0eb2-4cb7-9536-0ba523de8a0d None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:41.485570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a855ca9-0eb2-4cb7-9536-0ba523de8a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:41.506460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-3a855ca9-0eb2-4cb7-9536-0ba523de8a0d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:41.507652 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-3a855ca9-0eb2-4cb7-9536-0ba523de8a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:41.515967 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:41.707162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1179-c70f-45a3-a1ad-2d22aa5e9455 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:41.727348 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da1179-c70f-45a3-a1ad-2d22aa5e9455 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:41.733071 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00292f97-972a-4912-bfd9-aa5f96a3b5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:41.733650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292f97-972a-4912-bfd9-aa5f96a3b5a3 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:41.733926 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292f97-972a-4912-bfd9-aa5f96a3b5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:41.734196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00292f97-972a-4912-bfd9-aa5f96a3b5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:41.743258 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00292f97-972a-4912-bfd9-aa5f96a3b5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:41.744868 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00292f97-972a-4912-bfd9-aa5f96a3b5a3 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:41.754851 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 520/1036] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:42.650075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d406628-2c96-4589-8245-3eadf73476b7 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:42.651049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d406628-2c96-4589-8245-3eadf73476b7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:42.651049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d406628-2c96-4589-8245-3eadf73476b7 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:42.653106 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:42.659088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476cad-284e-499b-9ab6-10d1fd5a5403 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:42.659817 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476cad-284e-499b-9ab6-10d1fd5a5403 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:42.660005 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476cad-284e-499b-9ab6-10d1fd5a5403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:42.686148 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-5c476cad-284e-499b-9ab6-10d1fd5a5403 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:42.687384 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-5c476cad-284e-499b-9ab6-10d1fd5a5403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:42.696558 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:42.855579 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d406628-2c96-4589-8245-3eadf73476b7 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:42.872395 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d406628-2c96-4589-8245-3eadf73476b7 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:42.877777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebed912-e03a-4986-b8d4-5d67b1dcd093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:42.878371 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebed912-e03a-4986-b8d4-5d67b1dcd093 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:42.878685 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebed912-e03a-4986-b8d4-5d67b1dcd093 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:42.878956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebed912-e03a-4986-b8d4-5d67b1dcd093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:42.887448 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebed912-e03a-4986-b8d4-5d67b1dcd093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:42.889022 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebed912-e03a-4986-b8d4-5d67b1dcd093 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:42.899076 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 518/1039] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:38:43.764940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8730af-c260-4cd8-b32c-4e547799ca30 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:43.765553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8730af-c260-4cd8-b32c-4e547799ca30 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:43.765553 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8730af-c260-4cd8-b32c-4e547799ca30 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:43.766868 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:43.772980 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3977a7-b0d6-4ac9-889d-d4856c3417a9 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:43.773724 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3977a7-b0d6-4ac9-889d-d4856c3417a9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:43.773850 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3977a7-b0d6-4ac9-889d-d4856c3417a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:43.797676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-ee3977a7-b0d6-4ac9-889d-d4856c3417a9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:43.798916 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-ee3977a7-b0d6-4ac9-889d-d4856c3417a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:43.807250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:43.966138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8730af-c260-4cd8-b32c-4e547799ca30 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:43.982490 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8730af-c260-4cd8-b32c-4e547799ca30 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:43.988984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c92ffa-ce61-44d9-a38d-506beea52500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:43.989583 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c92ffa-ce61-44d9-a38d-506beea52500 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:43.989854 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c92ffa-ce61-44d9-a38d-506beea52500 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:43.990118 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c92ffa-ce61-44d9-a38d-506beea52500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:43.998650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c92ffa-ce61-44d9-a38d-506beea52500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:44.000267 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c92ffa-ce61-44d9-a38d-506beea52500 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:44.010338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 523/1042] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:44.873292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf940-0ecc-416e-949c-dfa98e56f717 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:44.873827 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf940-0ecc-416e-949c-dfa98e56f717 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:44.873827 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf940-0ecc-416e-949c-dfa98e56f717 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:44.875108 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:44.880154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c4f7e-b0fc-43fc-b09c-aa6d8878b985 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:44.880580 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c4f7e-b0fc-43fc-b09c-aa6d8878b985 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:44.880673 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c4f7e-b0fc-43fc-b09c-aa6d8878b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:44.902655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-f82c4f7e-b0fc-43fc-b09c-aa6d8878b985 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:44.903879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-f82c4f7e-b0fc-43fc-b09c-aa6d8878b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:44.913223 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:45.072702 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caf940-0ecc-416e-949c-dfa98e56f717 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:45.089937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caf940-0ecc-416e-949c-dfa98e56f717 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:45.096567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb2909-1b82-4904-a49a-b872557577dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:45.097160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb2909-1b82-4904-a49a-b872557577dd service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:45.097436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb2909-1b82-4904-a49a-b872557577dd service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:45.097707 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb2909-1b82-4904-a49a-b872557577dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:45.105804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb2909-1b82-4904-a49a-b872557577dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:45.107414 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb2909-1b82-4904-a49a-b872557577dd service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:45.116788 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 521/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:45.912984 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43887f-4f9d-4254-ba06-61c7fbb5b325 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:45.913487 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43887f-4f9d-4254-ba06-61c7fbb5b325 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:45.913487 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43887f-4f9d-4254-ba06-61c7fbb5b325 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:45.914890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:45.927548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34def-6b9c-4c86-a820-2d7e24ee0425 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:45.928008 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34def-6b9c-4c86-a820-2d7e24ee0425 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:45.928120 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34def-6b9c-4c86-a820-2d7e24ee0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:45.947695 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-89d34def-6b9c-4c86-a820-2d7e24ee0425 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:45.948874 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-89d34def-6b9c-4c86-a820-2d7e24ee0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:45.957603 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:46.111910 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43887f-4f9d-4254-ba06-61c7fbb5b325 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:46.126224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43887f-4f9d-4254-ba06-61c7fbb5b325 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:46.131413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5571e5-84a4-46fe-8a48-075cb47cc601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:46.132033 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5571e5-84a4-46fe-8a48-075cb47cc601 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:46.132309 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5571e5-84a4-46fe-8a48-075cb47cc601 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:46.132578 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5571e5-84a4-46fe-8a48-075cb47cc601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:46.140644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5571e5-84a4-46fe-8a48-075cb47cc601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:46.142240 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5571e5-84a4-46fe-8a48-075cb47cc601 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:46.152642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 526/1048] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:46.952501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204645-bb0d-49d3-88c0-92e5c11b7408 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:46.953053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204645-bb0d-49d3-88c0-92e5c11b7408 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:46.953053 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36204645-bb0d-49d3-88c0-92e5c11b7408 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:46.954364 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:46.960439 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa90e-828a-478d-a79b-68455095ff83 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:46.960881 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa90e-828a-478d-a79b-68455095ff83 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:46.961026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa90e-828a-478d-a79b-68455095ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:46.985813 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-365fa90e-828a-478d-a79b-68455095ff83 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:46.987055 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-365fa90e-828a-478d-a79b-68455095ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:46.996392 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:47.151733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204645-bb0d-49d3-88c0-92e5c11b7408 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:47.175022 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36204645-bb0d-49d3-88c0-92e5c11b7408 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:47.180871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2f3b5-ba83-4ccc-a4c5-299bc453ef7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:47.181460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2f3b5-ba83-4ccc-a4c5-299bc453ef7e service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:47.181733 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2f3b5-ba83-4ccc-a4c5-299bc453ef7e service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:47.181998 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2f3b5-ba83-4ccc-a4c5-299bc453ef7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:47.190823 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2f3b5-ba83-4ccc-a4c5-299bc453ef7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:47.192412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2f3b5-ba83-4ccc-a4c5-299bc453ef7e service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:47.202075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 524/1051] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:48.003188 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab6313-4714-40ca-96c8-7590d184eed4 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:48.003808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab6313-4714-40ca-96c8-7590d184eed4 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:48.003808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab6313-4714-40ca-96c8-7590d184eed4 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:48.005070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:48.013333 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571376-2ef4-4fec-bf1f-334df468b2bc None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:48.013776 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571376-2ef4-4fec-bf1f-334df468b2bc None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:48.013870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571376-2ef4-4fec-bf1f-334df468b2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:48.035427 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-d6571376-2ef4-4fec-bf1f-334df468b2bc None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:48.036616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-d6571376-2ef4-4fec-bf1f-334df468b2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:48.045469 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:48.201727 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab6313-4714-40ca-96c8-7590d184eed4 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:48.224890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab6313-4714-40ca-96c8-7590d184eed4 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:48.231216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88abe49-dfaa-4671-9a5f-bba09a001fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:48.231816 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abe49-dfaa-4671-9a5f-bba09a001fb0 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:48.232088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abe49-dfaa-4671-9a5f-bba09a001fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:48.232354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88abe49-dfaa-4671-9a5f-bba09a001fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:48.241491 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88abe49-dfaa-4671-9a5f-bba09a001fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:48.243124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88abe49-dfaa-4671-9a5f-bba09a001fb0 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:48.253069 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 529/1054] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:49.062374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5536-ba42-4473-aea7-010a86e9e025 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:49.063279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5536-ba42-4473-aea7-010a86e9e025 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:49.063279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b5536-ba42-4473-aea7-010a86e9e025 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:49.065161 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:38:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:49.073246 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dd8d5-75f4-4702-aaa8-7c522a5f0e6c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:49.073977 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dd8d5-75f4-4702-aaa8-7c522a5f0e6c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:49.074143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dd8d5-75f4-4702-aaa8-7c522a5f0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:49.102512 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-418dd8d5-75f4-4702-aaa8-7c522a5f0e6c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:49.103734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-418dd8d5-75f4-4702-aaa8-7c522a5f0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:49.113675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:38:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:49.269697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b5536-ba42-4473-aea7-010a86e9e025 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:49.286549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b5536-ba42-4473-aea7-010a86e9e025 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:49.292818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b28c-68ae-4414-9bb9-3a42668f9eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:49.293385 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b28c-68ae-4414-9bb9-3a42668f9eb5 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:49.293661 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b28c-68ae-4414-9bb9-3a42668f9eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:49.293922 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b28c-68ae-4414-9bb9-3a42668f9eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:49.302401 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b28c-68ae-4414-9bb9-3a42668f9eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:49.304014 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b28c-68ae-4414-9bb9-3a42668f9eb5 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:49.313151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 527/1057] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:51.352196 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12e7c4-5112-4ef4-8a2d-f68445360701 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:51.352775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12e7c4-5112-4ef4-8a2d-f68445360701 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:51.352775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12e7c4-5112-4ef4-8a2d-f68445360701 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:51.354097 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:51.360462 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656e8d7-23bb-493e-ab23-faa3e4cd7188 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:51.361176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656e8d7-23bb-493e-ab23-faa3e4cd7188 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:51.361430 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656e8d7-23bb-493e-ab23-faa3e4cd7188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:51.387889 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-2656e8d7-23bb-493e-ab23-faa3e4cd7188 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:51.389089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-2656e8d7-23bb-493e-ab23-faa3e4cd7188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:51.397996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:38:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:51.736064 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12e7c4-5112-4ef4-8a2d-f68445360701 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:51.748120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12e7c4-5112-4ef4-8a2d-f68445360701 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:51.752237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b4039-b4a7-4b0f-9630-47e553a39b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:51.752836 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b4039-b4a7-4b0f-9630-47e553a39b32 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:51.753106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b4039-b4a7-4b0f-9630-47e553a39b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:51.753374 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b4039-b4a7-4b0f-9630-47e553a39b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:51.763338 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b4039-b4a7-4b0f-9630-47e553a39b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:51.764794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b4039-b4a7-4b0f-9630-47e553a39b32 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:51.774492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 532/1060] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:54.113876 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f81327-1066-4786-892b-7174f6e4cb1d None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:54.114426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f81327-1066-4786-892b-7174f6e4cb1d None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:54.114426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f81327-1066-4786-892b-7174f6e4cb1d None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:54.116556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:38:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:54.125364 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a18aa-8035-44f9-afc3-d5ff72515442 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:54.125766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a18aa-8035-44f9-afc3-d5ff72515442 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:54.125961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a18aa-8035-44f9-afc3-d5ff72515442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:54.146397 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-0c5a18aa-8035-44f9-afc3-d5ff72515442 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:54.147695 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-0c5a18aa-8035-44f9-afc3-d5ff72515442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:54.156549 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:38:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:54.498138 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f81327-1066-4786-892b-7174f6e4cb1d None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:54.512530 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f81327-1066-4786-892b-7174f6e4cb1d None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:54.516907 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3708df7-dd4e-49da-9716-ff2c2db6d68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:54.517570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3708df7-dd4e-49da-9716-ff2c2db6d68d service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:54.517848 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3708df7-dd4e-49da-9716-ff2c2db6d68d service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:54.518117 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3708df7-dd4e-49da-9716-ff2c2db6d68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:54.527760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3708df7-dd4e-49da-9716-ff2c2db6d68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:54.529203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3708df7-dd4e-49da-9716-ff2c2db6d68d service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:54.538984 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 530/1063] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:57.096569 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b286-7fcd-4b17-820e-05a56b71f8c0 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:57.097450 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b286-7fcd-4b17-820e-05a56b71f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:57.097450 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b286-7fcd-4b17-820e-05a56b71f8c0 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:57.099720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:57.105638 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf3c4-90c5-49bf-bcea-410badee48a9 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:57.106095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf3c4-90c5-49bf-bcea-410badee48a9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:57.106188 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf3c4-90c5-49bf-bcea-410badee48a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:57.128175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-a8abf3c4-90c5-49bf-bcea-410badee48a9 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:57.130055 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-a8abf3c4-90c5-49bf-bcea-410badee48a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:57.144950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:38:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:38:57.485105 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b286-7fcd-4b17-820e-05a56b71f8c0 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:38:57.502789 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b286-7fcd-4b17-820e-05a56b71f8c0 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:38:57.506784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deb0fd-467e-4652-830e-a9529d3f644c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:38:57.507375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deb0fd-467e-4652-830e-a9529d3f644c service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:57.507645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deb0fd-467e-4652-830e-a9529d3f644c service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:57.507938 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deb0fd-467e-4652-830e-a9529d3f644c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:57.517516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deb0fd-467e-4652-830e-a9529d3f644c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:38:57.518989 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deb0fd-467e-4652-830e-a9529d3f644c service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:38:57.528714 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 535/1066] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:38:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:38:59.802363 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355b2e-6fa9-4916-aaac-b0442fe80e62 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:59.802968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355b2e-6fa9-4916-aaac-b0442fe80e62 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:59.802968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355b2e-6fa9-4916-aaac-b0442fe80e62 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:59.804275 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:38:59.810866 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3f5cb-b866-496c-9425-bd3c6863c79d None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:38:59.811580 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3f5cb-b866-496c-9425-bd3c6863c79d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:38:59.811766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3f5cb-b866-496c-9425-bd3c6863c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:38:59.838480 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-8ee3f5cb-b866-496c-9425-bd3c6863c79d None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:38:59.839739 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-8ee3f5cb-b866-496c-9425-bd3c6863c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:38:59.849295 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:38:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:00.189166 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08355b2e-6fa9-4916-aaac-b0442fe80e62 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:00.204751 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08355b2e-6fa9-4916-aaac-b0442fe80e62 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:00.209688 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cd3ca-46da-4311-bb99-96c74aabd15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:00.210358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cd3ca-46da-4311-bb99-96c74aabd15d service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:00.210696 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cd3ca-46da-4311-bb99-96c74aabd15d service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:00.210977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cd3ca-46da-4311-bb99-96c74aabd15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:00.222190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cd3ca-46da-4311-bb99-96c74aabd15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:00.223653 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cd3ca-46da-4311-bb99-96c74aabd15d service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:00.232859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 533/1069] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:02.456826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5d520-1c6d-4e2c-b863-d5f1ffdbc11c None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:02.457698 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5d520-1c6d-4e2c-b863-d5f1ffdbc11c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:02.457698 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5d520-1c6d-4e2c-b863-d5f1ffdbc11c None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:02.459870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:02.466502 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddab13-1952-4ee9-b361-37667641b5b4 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:02.467248 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddab13-1952-4ee9-b361-37667641b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:02.467426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddab13-1952-4ee9-b361-37667641b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:02.487977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-9bddab13-1952-4ee9-b361-37667641b5b4 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:02.489170 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9bddab13-1952-4ee9-b361-37667641b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:02.497664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:39:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:02.835048 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5d520-1c6d-4e2c-b863-d5f1ffdbc11c None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:02.847318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5d520-1c6d-4e2c-b863-d5f1ffdbc11c None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:02.851375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567a87c-5c4f-4a7e-98c9-f22644cbd9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:02.851964 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567a87c-5c4f-4a7e-98c9-f22644cbd9ef service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:02.852237 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567a87c-5c4f-4a7e-98c9-f22644cbd9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:02.852504 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567a87c-5c4f-4a7e-98c9-f22644cbd9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:02.861719 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567a87c-5c4f-4a7e-98c9-f22644cbd9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:02.863198 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567a87c-5c4f-4a7e-98c9-f22644cbd9ef service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:02.872810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 538/1072] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:05.121467 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9c70-df9b-4c04-a04a-2b59dbd786ea None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:05.122092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9c70-df9b-4c04-a04a-2b59dbd786ea None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:05.122092 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9c70-df9b-4c04-a04a-2b59dbd786ea None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:05.123367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:39:05.129744 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a632-8529-4977-98eb-bfe2482ecccb None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:05.130183 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a632-8529-4977-98eb-bfe2482ecccb None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:05.130319 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a632-8529-4977-98eb-bfe2482ecccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:05.155144 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-0727a632-8529-4977-98eb-bfe2482ecccb None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:05.156291 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-0727a632-8529-4977-98eb-bfe2482ecccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:05.165194 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:39:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:05.504376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9c70-df9b-4c04-a04a-2b59dbd786ea None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:05.522122 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9c70-df9b-4c04-a04a-2b59dbd786ea None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:05.528988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87033a-5990-4e8b-a559-258bef28eb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:05.529697 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87033a-5990-4e8b-a559-258bef28eb70 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:05.530006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87033a-5990-4e8b-a559-258bef28eb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:05.530417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87033a-5990-4e8b-a559-258bef28eb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:05.540840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87033a-5990-4e8b-a559-258bef28eb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:05.542269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87033a-5990-4e8b-a559-258bef28eb70 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:05.551729 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 536/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:07.765649 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab6f14-23ab-484b-bb58-42921c2f121e None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:07.766214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab6f14-23ab-484b-bb58-42921c2f121e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:07.766214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab6f14-23ab-484b-bb58-42921c2f121e None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:07.767632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:07.774650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1631-798c-4b28-9828-151231508930 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:07.775118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1631-798c-4b28-9828-151231508930 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:07.775214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1631-798c-4b28-9828-151231508930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:07.783079 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=70 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:07.796895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-910d1631-798c-4b28-9828-151231508930 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:07.798089 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-910d1631-798c-4b28-9828-151231508930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:07.806601 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:39:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:08.149026 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab6f14-23ab-484b-bb58-42921c2f121e None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:08.155321 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=73 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:08.161990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab6f14-23ab-484b-bb58-42921c2f121e None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:08.166160 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec6ed-e46e-4bf1-894b-5cabc2346bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:08.167006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec6ed-e46e-4bf1-894b-5cabc2346bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:08.167423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec6ed-e46e-4bf1-894b-5cabc2346bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:08.167853 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec6ed-e46e-4bf1-894b-5cabc2346bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:08.180232 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ec6ed-e46e-4bf1-894b-5cabc2346bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:08.181694 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ec6ed-e46e-4bf1-894b-5cabc2346bf2 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:08.191300 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 541/1078] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:39:10.416758 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d784892-4c6b-4100-9e8d-81ef4f6e4d51 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:10.417722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d784892-4c6b-4100-9e8d-81ef4f6e4d51 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:10.417722 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d784892-4c6b-4100-9e8d-81ef4f6e4d51 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:10.419753 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:10.425145 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205401-d322-4e85-9200-8398d7151676 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:10.425599 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205401-d322-4e85-9200-8398d7151676 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:10.425705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205401-d322-4e85-9200-8398d7151676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:10.446236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-cb205401-d322-4e85-9200-8398d7151676 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:10.447461 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-cb205401-d322-4e85-9200-8398d7151676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:10.456213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:39:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:10.790617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d784892-4c6b-4100-9e8d-81ef4f6e4d51 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:10.809620 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d784892-4c6b-4100-9e8d-81ef4f6e4d51 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:10.815763 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f966e-2e95-4f66-8872-4c7cec4fc57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:10.816360 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f966e-2e95-4f66-8872-4c7cec4fc57e service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:10.816673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f966e-2e95-4f66-8872-4c7cec4fc57e service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:10.816944 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f966e-2e95-4f66-8872-4c7cec4fc57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:10.826264 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f966e-2e95-4f66-8872-4c7cec4fc57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:10.827847 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f966e-2e95-4f66-8872-4c7cec4fc57e service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:10.837539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 539/1081] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:12.990472 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535490a-547d-40cd-adc5-a60f9a952b83 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:12.991051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535490a-547d-40cd-adc5-a60f9a952b83 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:12.991051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535490a-547d-40cd-adc5-a60f9a952b83 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:12.992396 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:12.998834 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb878b4-0e12-49c6-a661-0e4ac3f07fe7 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:12.999285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb878b4-0e12-49c6-a661-0e4ac3f07fe7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:12.999389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb878b4-0e12-49c6-a661-0e4ac3f07fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:13.020249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-4fb878b4-0e12-49c6-a661-0e4ac3f07fe7 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:13.021436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-4fb878b4-0e12-49c6-a661-0e4ac3f07fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:13.029720 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:39:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:13.364642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535490a-547d-40cd-adc5-a60f9a952b83 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:13.376668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535490a-547d-40cd-adc5-a60f9a952b83 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:13.380866 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac34e5-11e8-41d9-ba7c-1a5cebb0be88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:13.381456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac34e5-11e8-41d9-ba7c-1a5cebb0be88 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:13.381729 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac34e5-11e8-41d9-ba7c-1a5cebb0be88 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:13.381994 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac34e5-11e8-41d9-ba7c-1a5cebb0be88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:13.391740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac34e5-11e8-41d9-ba7c-1a5cebb0be88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:13.393236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac34e5-11e8-41d9-ba7c-1a5cebb0be88 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:13.402766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 544/1084] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:15.603292 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba1c3-4cf0-4278-a4b6-a086997ba9fa None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:15.603881 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba1c3-4cf0-4278-a4b6-a086997ba9fa None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:15.603881 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ba1c3-4cf0-4278-a4b6-a086997ba9fa None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:15.605168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:15.611478 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408001d6-54b1-4c36-8c0b-94bb7509f4b6 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:15.611955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408001d6-54b1-4c36-8c0b-94bb7509f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:15.612085 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408001d6-54b1-4c36-8c0b-94bb7509f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:15.632817 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-408001d6-54b1-4c36-8c0b-94bb7509f4b6 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:15.633952 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-408001d6-54b1-4c36-8c0b-94bb7509f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:15.642805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:39:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:15.975730 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ba1c3-4cf0-4278-a4b6-a086997ba9fa None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:15.994203 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ba1c3-4cf0-4278-a4b6-a086997ba9fa None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:16.000750 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dae2c3-ad96-40d7-8c86-c298d15e49a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:16.001589 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dae2c3-ad96-40d7-8c86-c298d15e49a7 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:16.001919 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dae2c3-ad96-40d7-8c86-c298d15e49a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:16.002158 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dae2c3-ad96-40d7-8c86-c298d15e49a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:16.012531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dae2c3-ad96-40d7-8c86-c298d15e49a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:16.013971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dae2c3-ad96-40d7-8c86-c298d15e49a7 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:16.027482 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 542/1087] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:25.627349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=17 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:26.020138 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=17 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:39:39.693053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71454f-138b-45f7-8e6c-8a3762ff239b None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:39.693679 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71454f-138b-45f7-8e6c-8a3762ff239b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:39.693679 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71454f-138b-45f7-8e6c-8a3762ff239b None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:39.695046 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 546/1088] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:39.701693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d72a41-5ca5-4701-b4ed-64a9a9a76f7b None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:39.702537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d72a41-5ca5-4701-b4ed-64a9a9a76f7b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:39.702537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d72a41-5ca5-4701-b4ed-64a9a9a76f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:39.723870 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-d0d72a41-5ca5-4701-b4ed-64a9a9a76f7b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:39.725081 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-d0d72a41-5ca5-4701-b4ed-64a9a9a76f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:39.734405 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 543/1089] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:40.091381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41ffe-895c-4fb0-a8b8-26f755d9ce85 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:40.091776 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41ffe-895c-4fb0-a8b8-26f755d9ce85 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:40.092140 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41ffe-895c-4fb0-a8b8-26f755d9ce85 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:40.094229 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 547/1090] 10.222.0.15 () {54 vars in 967 bytes} [Sat Aug 27 20:39:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:40.099757 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ac865-3972-4665-a291-e201c2f9766f None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:40.100006 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ac865-3972-4665-a291-e201c2f9766f None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:40.100273 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ac865-3972-4665-a291-e201c2f9766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:40.120792 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-448ac865-3972-4665-a291-e201c2f9766f None None] MFA Rules not processed for user `01102d0faa3845e0a76afc772579e808`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:40.121971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-448ac865-3972-4665-a291-e201c2f9766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:40.129336 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 544/1091] 10.222.0.15 () {58 vars in 1064 bytes} [Sat Aug 27 20:39:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:40.136779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac41ffe-895c-4fb0-a8b8-26f755d9ce85 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:40.148980 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac41ffe-895c-4fb0-a8b8-26f755d9ce85 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:40.152898 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be0f0-905c-4e33-a998-cc3d45d91a8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01102d0faa3845e0a76afc772579e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:40.153479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be0f0-905c-4e33-a998-cc3d45d91a8f service glance] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:40.153748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be0f0-905c-4e33-a998-cc3d45d91a8f service glance] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:40.154010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be0f0-905c-4e33-a998-cc3d45d91a8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:40.163077 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be0f0-905c-4e33-a998-cc3d45d91a8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:40.164506 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be0f0-905c-4e33-a998-cc3d45d91a8f service glance] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:40.173809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 548/1092] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:42.425857 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081aeb1-984c-484b-b9ca-1b24b685e054 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:42.426491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081aeb1-984c-484b-b9ca-1b24b685e054 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:42.426491 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081aeb1-984c-484b-b9ca-1b24b685e054 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:42.428319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 545/1093] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:42.433941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6778-ccb9-4f4a-a03e-c19ea0105871 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:42.434381 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6778-ccb9-4f4a-a03e-c19ea0105871 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:42.434534 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c6778-ccb9-4f4a-a03e-c19ea0105871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:42.454585 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-431c6778-ccb9-4f4a-a03e-c19ea0105871 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:42.455779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-431c6778-ccb9-4f4a-a03e-c19ea0105871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:42.464371 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 549/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:42.798798 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081aeb1-984c-484b-b9ca-1b24b685e054 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:42.820409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081aeb1-984c-484b-b9ca-1b24b685e054 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:42.826803 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:42.827396 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:42.827673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:42.827942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:42.828601 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:42.830374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:39:42.830374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:39:42.830374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:39:42.831532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f112cb-791d-44a2-bb4c-a4fa99381f5c admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:42.849871 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 546/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 27 20:39:42 2022] GET /identity/v3/projects => generated 1606 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:39:44.998186 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1918e7-7c7a-4d8e-9eb4-3888057c6c07 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:44.998810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1918e7-7c7a-4d8e-9eb4-3888057c6c07 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:44.998810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1918e7-7c7a-4d8e-9eb4-3888057c6c07 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:45.000096 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 550/1096] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:45.006251 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041efbca-1bdb-48d5-ac53-b8a9c591463e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:45.006704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041efbca-1bdb-48d5-ac53-b8a9c591463e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:45.006857 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041efbca-1bdb-48d5-ac53-b8a9c591463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:45.027191 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-041efbca-1bdb-48d5-ac53-b8a9c591463e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:45.028399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-041efbca-1bdb-48d5-ac53-b8a9c591463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:45.036988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 547/1097] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:45.388043 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1918e7-7c7a-4d8e-9eb4-3888057c6c07 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:45.403164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1918e7-7c7a-4d8e-9eb4-3888057c6c07 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:45.409210 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ea006-08b1-4d3b-b513-cd7fca966646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:45.409810 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ea006-08b1-4d3b-b513-cd7fca966646 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:45.410080 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ea006-08b1-4d3b-b513-cd7fca966646 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:45.410347 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ea006-08b1-4d3b-b513-cd7fca966646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:45.418726 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ea006-08b1-4d3b-b513-cd7fca966646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:45.420313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ea006-08b1-4d3b-b513-cd7fca966646 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:45.429893 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 551/1098] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:47.786175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8481b-bfc4-4b20-a58a-29b6b22c237e None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:47.787121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8481b-bfc4-4b20-a58a-29b6b22c237e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:47.787121 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8481b-bfc4-4b20-a58a-29b6b22c237e None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:47.789129 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 548/1099] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:47.798082 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118093c4-4041-4b68-897c-85c8a5f115db None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:47.798548 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118093c4-4041-4b68-897c-85c8a5f115db None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:47.798653 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118093c4-4041-4b68-897c-85c8a5f115db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:47.820429 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-118093c4-4041-4b68-897c-85c8a5f115db None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:47.821684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-118093c4-4041-4b68-897c-85c8a5f115db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:47.831681 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 552/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:48.171616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8481b-bfc4-4b20-a58a-29b6b22c237e None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:48.183548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8481b-bfc4-4b20-a58a-29b6b22c237e None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:48.187699 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbb223-c5f7-4d96-9b16-b9a7803a2b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:48.188340 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb223-c5f7-4d96-9b16-b9a7803a2b63 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:48.188616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb223-c5f7-4d96-9b16-b9a7803a2b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:48.188884 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbb223-c5f7-4d96-9b16-b9a7803a2b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:48.197990 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb223-c5f7-4d96-9b16-b9a7803a2b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:48.199481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbb223-c5f7-4d96-9b16-b9a7803a2b63 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:48.208949 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 549/1101] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:50.398575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c70c7a-cacb-419d-a1e8-3c996052b60a None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:50.399456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c70c7a-cacb-419d-a1e8-3c996052b60a None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:50.399456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c70c7a-cacb-419d-a1e8-3c996052b60a None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:50.401684 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 553/1102] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:50.407690 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43ebce-4252-4ffa-b21a-e87d730f9897 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:50.408117 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43ebce-4252-4ffa-b21a-e87d730f9897 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:50.408225 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43ebce-4252-4ffa-b21a-e87d730f9897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:50.428040 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-db43ebce-4252-4ffa-b21a-e87d730f9897 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:50.429240 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-db43ebce-4252-4ffa-b21a-e87d730f9897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:50.438193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 550/1103] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:50.787633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c70c7a-cacb-419d-a1e8-3c996052b60a None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:50.803715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c70c7a-cacb-419d-a1e8-3c996052b60a None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:50.808267 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc465482-79e0-4517-b176-2f86e1110511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:50.808862 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc465482-79e0-4517-b176-2f86e1110511 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:50.809165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc465482-79e0-4517-b176-2f86e1110511 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:50.809433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc465482-79e0-4517-b176-2f86e1110511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:50.819591 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc465482-79e0-4517-b176-2f86e1110511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:50.821040 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc465482-79e0-4517-b176-2f86e1110511 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:50.832022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 554/1104] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:53.120687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3553cd-c468-4a79-9d4e-6511cbc06921 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:53.121604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3553cd-c468-4a79-9d4e-6511cbc06921 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:53.121604 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3553cd-c468-4a79-9d4e-6511cbc06921 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:53.123654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 551/1105] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:53.132711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ea571-c4b0-475c-bc0c-de46ffd5b212 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:53.133154 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ea571-c4b0-475c-bc0c-de46ffd5b212 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:53.133294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ea571-c4b0-475c-bc0c-de46ffd5b212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:53.157258 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-ca8ea571-c4b0-475c-bc0c-de46ffd5b212 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:53.158390 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ca8ea571-c4b0-475c-bc0c-de46ffd5b212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:53.166422 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 555/1106] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:53.522386 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3553cd-c468-4a79-9d4e-6511cbc06921 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:53.535982 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3553cd-c468-4a79-9d4e-6511cbc06921 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:53.539791 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e86a74-59dc-4720-a6d5-fd761053d67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:53.540378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86a74-59dc-4720-a6d5-fd761053d67e service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:53.540650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86a74-59dc-4720-a6d5-fd761053d67e service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:53.540919 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86a74-59dc-4720-a6d5-fd761053d67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:53.549958 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e86a74-59dc-4720-a6d5-fd761053d67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:53.551420 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e86a74-59dc-4720-a6d5-fd761053d67e service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:53.560742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 552/1107] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:39:55.928492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb133c2-7d6e-4fec-bf87-08bb470b6621 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:55.929033 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb133c2-7d6e-4fec-bf87-08bb470b6621 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:55.929137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb133c2-7d6e-4fec-bf87-08bb470b6621 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:55.931412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 556/1108] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 27 20:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:39:55.936810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bb183-0864-4c76-8791-f8679d91a785 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:55.937256 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bb183-0864-4c76-8791-f8679d91a785 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:55.937357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bb183-0864-4c76-8791-f8679d91a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:55.957276 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-406bb183-0864-4c76-8791-f8679d91a785 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:39:55.958521 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-406bb183-0864-4c76-8791-f8679d91a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:39:55.967351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 553/1109] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 27 20:39:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:39:56.313456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb133c2-7d6e-4fec-bf87-08bb470b6621 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:39:56.330971 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb133c2-7d6e-4fec-bf87-08bb470b6621 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:39:56.334962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21100de3-1e5f-4136-8a83-62ceebe59083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:39:56.335565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21100de3-1e5f-4136-8a83-62ceebe59083 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:39:56.335839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21100de3-1e5f-4136-8a83-62ceebe59083 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:39:56.336103 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21100de3-1e5f-4136-8a83-62ceebe59083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:39:56.346315 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21100de3-1e5f-4136-8a83-62ceebe59083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:39:56.347808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21100de3-1e5f-4136-8a83-62ceebe59083 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:39:56.366123 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 557/1110] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:39:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:40:05.952304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=33 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:40:06.357021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=33 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:41:17.381369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.382289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.382289 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.411710 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:41:17.412900 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:17.422351 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 554/1111] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:41:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:41:17.430535 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.431049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.431049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.451377 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:41:17.452574 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:17.461325 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 558/1112] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:41:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:41:17.466159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:17.476290 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d586-bb8a-4e3e-8cee-959bc0263810 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:17.481842 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:17.482407 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.482718 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.482985 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.483631 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:41:17.483934 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:17.484955 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:17.484955 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:41:17.484955 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:41:17.485841 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:17.497899 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 555/1113] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 27 20:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:41:17.505955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:17.515687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432f2a-fce7-4dca-8924-f9b7a0457db8 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:17.521211 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:17.521831 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.522098 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.522356 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.523022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:17.524820 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:17.524820 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:41:17.524820 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:41:17.526012 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:17.557098 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 559/1114] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 27 20:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:41:17.561347 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:17.571656 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7190d-46c6-473a-931d-e2c51843d231 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:17.629760 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:17.630285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.630595 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.630864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.631496 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:17.632511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:17.632511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:41:17.632511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:41:17.633708 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:17.656729 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 556/1115] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:41:17 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:41:17.660715 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:17.671195 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137d6ae-5592-42c5-90f5-6d29cf1b6b2c admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:17.676611 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:17.677206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.677477 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.677741 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.678382 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:17.679434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:17.679434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:41:17.679434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:41:17.680326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:17.693264 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 560/1116] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 20:41:17.697243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:17.710537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac41678-114d-486f-8cb8-219d3328cece admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:17.716983 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:17.717572 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.717883 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.718142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.718804 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:17.719815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:17.719815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:41:17.719815 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:41:17.720691 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a454a-931c-4827-9573-3422224fda7c admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:17.735145 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 557/1117] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:41:17.741522 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:17.757692 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71a88e-6d74-4b4f-997c-8075c37a0b22 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:17.766283 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:17.766967 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.767239 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.767503 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] PATH_INFO: `/v3/projects/804f631caec64e46a7aefcc4ec0d1d21/users/5e38aa08e60c4b209475e899e63cac71/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.782734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804f631caec64e46a7aefcc4ec0d1d21, user_id=5e38aa08e60c4b209475e899e63cac71, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:17.783770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:17.783770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:41:17.783770 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:41:17.785691 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd74878-cb9f-439b-980d-10a5ed8cc592 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:17.800488 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 561/1118] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:41:17 2022] PUT /identity/v3/projects/804f631caec64e46a7aefcc4ec0d1d21/users/5e38aa08e60c4b209475e899e63cac71/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:41:17.812800 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc607d-4814-47de-bcea-6423a2c8f943 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.813085 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc607d-4814-47de-bcea-6423a2c8f943 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.813358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc607d-4814-47de-bcea-6423a2c8f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.841836 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-4bdc607d-4814-47de-bcea-6423a2c8f943 None None] MFA Rules not processed for user `5e38aa08e60c4b209475e899e63cac71`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:41:17.843141 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-4bdc607d-4814-47de-bcea-6423a2c8f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:17.911012 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 558/1119] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:41:17 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:41:17.924504 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29146-04f4-46ee-abe9-e0ea861104ec None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.924783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29146-04f4-46ee-abe9-e0ea861104ec None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.925051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29146-04f4-46ee-abe9-e0ea861104ec None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.926420 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 562/1120] 10.222.0.15 () {54 vars in 964 bytes} [Sat Aug 27 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:41:17.931413 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c0594-6bf6-4a9e-b11b-a7eb083bc397 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:17.931698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c0594-6bf6-4a9e-b11b-a7eb083bc397 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:17.931968 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c0594-6bf6-4a9e-b11b-a7eb083bc397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:17.951410 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-786c0594-6bf6-4a9e-b11b-a7eb083bc397 None None] MFA Rules not processed for user `ed5cc105367448a59da0ce5cfe60e175`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:41:17.952633 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-786c0594-6bf6-4a9e-b11b-a7eb083bc397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:17.996569 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:41:18.004952 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 559/1121] 10.222.0.15 () {58 vars in 1061 bytes} [Sat Aug 27 20:41:17 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:41:18.012727 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a29146-04f4-46ee-abe9-e0ea861104ec None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:18.023710 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a29146-04f4-46ee-abe9-e0ea861104ec None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:18.027409 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5cc105367448a59da0ce5cfe60e175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:18.027983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:18.028253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:18.028539 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:18.036809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:18.038236 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:18.046858 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 563/1122] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:41:18 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:41:18.091270 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6545-9080-47b5-bb84-fbde84e85c01 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:18.091555 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6545-9080-47b5-bb84-fbde84e85c01 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:18.091821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6545-9080-47b5-bb84-fbde84e85c01 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:18.093142 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 560/1123] 10.222.0.15 () {52 vars in 830 bytes} [Sat Aug 27 20:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:41:18.097370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:18.168016 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58365b82-adcf-42c2-8129-230b827a427a service cinder] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:18.173459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:18.174086 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:18.174354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:18.174650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] PATH_INFO: `/v3/users/5e38aa08e60c4b209475e899e63cac71` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:18.175896 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e38aa08e60c4b209475e899e63cac71)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:18.176924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:18.176924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:41:18.176924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:41:18.178138 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:18.250124 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e38aa08e60c4b209475e899e63cac71'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.250894 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e38aa08e60c4b209475e899e63cac71'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.262762 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e38aa08e60c4b209475e899e63cac71'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.276565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e38aa08e60c4b209475e899e63cac71'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.300921 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e38aa08e60c4b209475e899e63cac71'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.307392 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 564/1124] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 27 20:41:18 2022] DELETE /identity/v3/users/5e38aa08e60c4b209475e899e63cac71 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:41:18.312049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:18.312326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:18.312594 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:18.332262 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:41:18.333455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:18.395358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 561/1125] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:41:18.405646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:18.407324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:18.413212 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:41:18.470552 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e50de-2b70-4fad-9476-21bbfd8eea7d admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:18.474678 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158e254-bfee-46d3-b724-bad3de6c85b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:18.475288 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158e254-bfee-46d3-b724-bad3de6c85b2 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:18.475562 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158e254-bfee-46d3-b724-bad3de6c85b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:18.475826 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158e254-bfee-46d3-b724-bad3de6c85b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:18.485184 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158e254-bfee-46d3-b724-bad3de6c85b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:18.486668 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158e254-bfee-46d3-b724-bad3de6c85b2 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:18.496468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 565/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:41:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:41:18.836989 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:41:18.838453 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:41:18.851107 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06c66-0959-4597-a4cd-adc31ff479da None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:41:18.856221 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:41:18.856856 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:41:18.857130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:41:18.857399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] PATH_INFO: `/v3/projects/804f631caec64e46a7aefcc4ec0d1d21` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:41:18.858680 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=804f631caec64e46a7aefcc4ec0d1d21)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:41:18.859711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:41:18.859711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:41:18.859711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:41:18.860888 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:41:18.925706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804f631caec64e46a7aefcc4ec0d1d21', 'request_id': 'req-755db72e-d801-42e4-a095-03aa6308e61b'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.932036 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804f631caec64e46a7aefcc4ec0d1d21', 'request_id': 'req-755db72e-d801-42e4-a095-03aa6308e61b'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.943621 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804f631caec64e46a7aefcc4ec0d1d21', 'request_id': 'req-755db72e-d801-42e4-a095-03aa6308e61b'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.971716 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] The token cache is being invalidate because project 804f631caec64e46a7aefcc4ec0d1d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 20:41:18.972005 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.972767 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-755db72e-d801-42e4-a095-03aa6308e61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:41:18.974544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 562/1127] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 27 20:41:18 2022] DELETE /identity/v3/projects/804f631caec64e46a7aefcc4ec0d1d21 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:41:28.492419 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=25 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:41:28.967980 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:42:37.425159 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa4cac-61be-4494-aef4-ed3e03a37021 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:37.425768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa4cac-61be-4494-aef4-ed3e03a37021 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:37.425768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa4cac-61be-4494-aef4-ed3e03a37021 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:37.427146 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:42:37.432826 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aef0a1-96c5-4643-a966-7f2a2284fa2e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:37.433290 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aef0a1-96c5-4643-a966-7f2a2284fa2e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:37.433402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aef0a1-96c5-4643-a966-7f2a2284fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:37.519268 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-50aef0a1-96c5-4643-a966-7f2a2284fa2e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:42:37.520483 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-50aef0a1-96c5-4643-a966-7f2a2284fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:37.632371 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:42:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:42:37.798128 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa4cac-61be-4494-aef4-ed3e03a37021 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:42:37.800970 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-93fa4cac-61be-4494-aef4-ed3e03a37021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:37.892499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa4cac-61be-4494-aef4-ed3e03a37021 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:42:37.898465 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b615-410d-4677-b24c-cde69da1163c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:42:37.899086 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b615-410d-4677-b24c-cde69da1163c service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:37.899363 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b615-410d-4677-b24c-cde69da1163c service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:37.899629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b615-410d-4677-b24c-cde69da1163c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:37.908387 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b615-410d-4677-b24c-cde69da1163c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:42:37.910070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b615-410d-4677-b24c-cde69da1163c service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:42:37.919617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 567/1130] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:42:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:42:38.752383 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234622ed-2114-4302-900f-9afa633d8b35 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:38.752979 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234622ed-2114-4302-900f-9afa633d8b35 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:38.752979 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234622ed-2114-4302-900f-9afa633d8b35 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:38.754309 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:42:38.760294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ccd04-8e9f-47c5-91fe-1cf29f24a98b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:38.761011 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ccd04-8e9f-47c5-91fe-1cf29f24a98b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:38.761210 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ccd04-8e9f-47c5-91fe-1cf29f24a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:38.784588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-2d7ccd04-8e9f-47c5-91fe-1cf29f24a98b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:42:38.785783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-2d7ccd04-8e9f-47c5-91fe-1cf29f24a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:38.795172 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:42:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:42:38.951835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234622ed-2114-4302-900f-9afa633d8b35 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:42:38.974490 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234622ed-2114-4302-900f-9afa633d8b35 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:42:38.980931 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bd4b6-a4a4-423e-b45a-a3f1bec63a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:42:38.981539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bd4b6-a4a4-423e-b45a-a3f1bec63a20 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:38.981812 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bd4b6-a4a4-423e-b45a-a3f1bec63a20 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:38.982077 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bd4b6-a4a4-423e-b45a-a3f1bec63a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:38.990377 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bd4b6-a4a4-423e-b45a-a3f1bec63a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:42:38.991986 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bd4b6-a4a4-423e-b45a-a3f1bec63a20 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:42:39.001057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 565/1133] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:42:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:42:44.447480 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3576-3d00-4ce7-92aa-b604c5e2dea3 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:44.448052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3576-3d00-4ce7-92aa-b604c5e2dea3 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:44.448052 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3576-3d00-4ce7-92aa-b604c5e2dea3 None None] PATH_INFO: `/v3` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:44.449294 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 569/1134] 10.222.0.42 () {54 vars in 925 bytes} [Sat Aug 27 20:42:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 20:42:44.456412 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958eb22-d6d7-4662-985f-a15afaf1bcc1 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:44.456890 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958eb22-d6d7-4662-985f-a15afaf1bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:44.456988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958eb22-d6d7-4662-985f-a15afaf1bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:44.489738 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-1958eb22-d6d7-4662-985f-a15afaf1bcc1 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:42:44.490794 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-1958eb22-d6d7-4662-985f-a15afaf1bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:44.560505 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:42:44.571005 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 566/1135] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Aug 27 20:42:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:42:48.779667 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=42 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:42:50.255273 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394c66-8ad2-415c-95b2-9860ab537e10 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:50.255924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394c66-8ad2-415c-95b2-9860ab537e10 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:50.255924 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394c66-8ad2-415c-95b2-9860ab537e10 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:50.257202 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:42:50.262177 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ed81-f0eb-4038-ad45-49c1b9046804 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:50.262609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ed81-f0eb-4038-ad45-49c1b9046804 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:50.262777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41ed81-f0eb-4038-ad45-49c1b9046804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:50.282988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-1a41ed81-f0eb-4038-ad45-49c1b9046804 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:42:50.284281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-1a41ed81-f0eb-4038-ad45-49c1b9046804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:50.292411 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:42:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:42:50.449841 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394c66-8ad2-415c-95b2-9860ab537e10 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:42:50.472410 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394c66-8ad2-415c-95b2-9860ab537e10 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:42:50.478078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8263066-874a-49fb-ac3d-d9baf398b1b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:42:50.478738 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263066-874a-49fb-ac3d-d9baf398b1b3 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:50.478998 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263066-874a-49fb-ac3d-d9baf398b1b3 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:50.479247 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8263066-874a-49fb-ac3d-d9baf398b1b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:50.488001 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263066-874a-49fb-ac3d-d9baf398b1b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:42:50.489596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8263066-874a-49fb-ac3d-d9baf398b1b3 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:42:50.499433 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 571/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:42:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:42:51.313423 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d840d-a2e5-4b06-b436-962db8af6bb2 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:51.314342 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d840d-a2e5-4b06-b436-962db8af6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:51.314342 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d840d-a2e5-4b06-b436-962db8af6bb2 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:51.316535 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:42:51.324769 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ef78-eb70-412c-b24c-6f18fcfc7982 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:51.325199 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ef78-eb70-412c-b24c-6f18fcfc7982 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:51.325332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ef78-eb70-412c-b24c-6f18fcfc7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:51.349012 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-d5f5ef78-eb70-412c-b24c-6f18fcfc7982 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:42:51.350217 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-d5f5ef78-eb70-412c-b24c-6f18fcfc7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:51.359696 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 572/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:42:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:42:51.517785 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d840d-a2e5-4b06-b436-962db8af6bb2 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:42:51.534499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d840d-a2e5-4b06-b436-962db8af6bb2 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:42:51.540269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3788-5429-4405-98ca-0bc49990b308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:42:51.540895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3788-5429-4405-98ca-0bc49990b308 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:51.541169 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3788-5429-4405-98ca-0bc49990b308 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:51.541433 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3788-5429-4405-98ca-0bc49990b308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:51.550653 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3788-5429-4405-98ca-0bc49990b308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:42:51.552224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3788-5429-4405-98ca-0bc49990b308 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:42:51.561845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 569/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:42:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:42:53.727757 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc41fa-2936-4078-be8f-b74924150d6b None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:53.728597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc41fa-2936-4078-be8f-b74924150d6b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:53.728597 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc41fa-2936-4078-be8f-b74924150d6b None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:53.729647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 573/1142] 10.222.0.15 () {54 vars in 961 bytes} [Sat Aug 27 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:42:53.735754 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2f94-c4d8-4968-8613-2e7597eded99 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:53.736249 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2f94-c4d8-4968-8613-2e7597eded99 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:53.736366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2f94-c4d8-4968-8613-2e7597eded99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:53.756684 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-b9ec2f94-c4d8-4968-8613-2e7597eded99 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:42:53.757879 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-b9ec2f94-c4d8-4968-8613-2e7597eded99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:42:53.767554 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 570/1143] 10.222.0.15 () {58 vars in 1058 bytes} [Sat Aug 27 20:42:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:42:53.775727 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc41fa-2936-4078-be8f-b74924150d6b None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:42:53.793760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc41fa-2936-4078-be8f-b74924150d6b None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:42:53.799784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f153133-a5c0-48a9-81ee-9a1178a1dac6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:42:53.800373 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153133-a5c0-48a9-81ee-9a1178a1dac6 service placement] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:42:53.800646 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153133-a5c0-48a9-81ee-9a1178a1dac6 service placement] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:42:53.800916 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f153133-a5c0-48a9-81ee-9a1178a1dac6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:42:53.809301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f153133-a5c0-48a9-81ee-9a1178a1dac6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:42:53.810923 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f153133-a5c0-48a9-81ee-9a1178a1dac6 service placement] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:42:53.820655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 574/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:42:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:02.808843 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af7173-ca9f-4ca1-94cd-d9556c5172a8 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:02.809450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af7173-ca9f-4ca1-94cd-d9556c5172a8 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:02.809450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af7173-ca9f-4ca1-94cd-d9556c5172a8 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:02.810775 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 571/1145] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:43:02.815776 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1316850-8dfd-4f0b-b428-cd0c0689ab15 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:02.816216 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1316850-8dfd-4f0b-b428-cd0c0689ab15 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:02.816322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1316850-8dfd-4f0b-b428-cd0c0689ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:02.839334 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-d1316850-8dfd-4f0b-b428-cd0c0689ab15 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:43:02.840581 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-d1316850-8dfd-4f0b-b428-cd0c0689ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:02.849315 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 575/1146] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:43:03.007774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af7173-ca9f-4ca1-94cd-d9556c5172a8 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:43:03.030114 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af7173-ca9f-4ca1-94cd-d9556c5172a8 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:43:03.037138 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84e3a9-3bf3-4b3f-b021-e5a3cffb2bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:43:03.037732 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84e3a9-3bf3-4b3f-b021-e5a3cffb2bf5 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:03.038003 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84e3a9-3bf3-4b3f-b021-e5a3cffb2bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:03.038291 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84e3a9-3bf3-4b3f-b021-e5a3cffb2bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:03.046615 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84e3a9-3bf3-4b3f-b021-e5a3cffb2bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:43:03.048175 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84e3a9-3bf3-4b3f-b021-e5a3cffb2bf5 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:43:03.057551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 572/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:43:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:03.882147 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b6530-8aed-434c-a5e5-39ecac80861d None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:03.882748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b6530-8aed-434c-a5e5-39ecac80861d None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:03.882748 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b6530-8aed-434c-a5e5-39ecac80861d None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:03.884318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 576/1148] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 20:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:43:03.889392 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2644-06b1-4ac9-9bb3-f146c6b9c97b None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:03.889821 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2644-06b1-4ac9-9bb3-f146c6b9c97b None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:03.889937 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2644-06b1-4ac9-9bb3-f146c6b9c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:03.909845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-241c2644-06b1-4ac9-9bb3-f146c6b9c97b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:43:03.911062 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-241c2644-06b1-4ac9-9bb3-f146c6b9c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:03.919750 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 573/1149] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 20:43:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:43:04.077644 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b6530-8aed-434c-a5e5-39ecac80861d None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:43:04.096122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b6530-8aed-434c-a5e5-39ecac80861d None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:43:04.104632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c3cb8-bd2b-491e-80d1-4afd5aa0d05f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:43:04.105222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3cb8-bd2b-491e-80d1-4afd5aa0d05f service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:04.105492 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3cb8-bd2b-491e-80d1-4afd5aa0d05f service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:04.105755 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c3cb8-bd2b-491e-80d1-4afd5aa0d05f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:04.115190 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c3cb8-bd2b-491e-80d1-4afd5aa0d05f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:43:04.116829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c3cb8-bd2b-491e-80d1-4afd5aa0d05f service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:43:04.126631 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 577/1150] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:43:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:08.063920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55684d-256e-45a3-b3ae-7f3e1d2cb0af None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:08.065135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55684d-256e-45a3-b3ae-7f3e1d2cb0af None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:08.065319 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55684d-256e-45a3-b3ae-7f3e1d2cb0af None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:08.067461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 574/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:43:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:43:08.076383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47aa6a-20ba-4e89-b737-57d481452e27 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:08.077141 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47aa6a-20ba-4e89-b737-57d481452e27 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:08.077343 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47aa6a-20ba-4e89-b737-57d481452e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:08.100101 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-bb47aa6a-20ba-4e89-b737-57d481452e27 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:43:08.101324 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-bb47aa6a-20ba-4e89-b737-57d481452e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:08.110753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 578/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:43:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:43:08.468905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55684d-256e-45a3-b3ae-7f3e1d2cb0af None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:43:08.471667 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-fb55684d-256e-45a3-b3ae-7f3e1d2cb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:08.534287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55684d-256e-45a3-b3ae-7f3e1d2cb0af None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:43:08.538220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357328-284d-43f6-9292-a4821218e723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:43:08.538851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357328-284d-43f6-9292-a4821218e723 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:08.539130 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357328-284d-43f6-9292-a4821218e723 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:08.539431 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357328-284d-43f6-9292-a4821218e723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:08.548779 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357328-284d-43f6-9292-a4821218e723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:43:08.550184 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357328-284d-43f6-9292-a4821218e723 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:43:08.559864 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 575/1153] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:43:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:10.716804 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb030d8f-f98b-43e2-805a-6cb46cf4a871 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:10.717359 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb030d8f-f98b-43e2-805a-6cb46cf4a871 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:10.717359 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb030d8f-f98b-43e2-805a-6cb46cf4a871 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:10.719449 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 579/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:43:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:43:10.725840 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631125-bae0-4869-81a3-bad450b7043c None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:10.726338 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631125-bae0-4869-81a3-bad450b7043c None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:10.726551 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631125-bae0-4869-81a3-bad450b7043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:10.756149 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-22631125-bae0-4869-81a3-bad450b7043c None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:43:10.757358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-22631125-bae0-4869-81a3-bad450b7043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:10.766880 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 576/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:43:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:43:11.111827 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb030d8f-f98b-43e2-805a-6cb46cf4a871 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:43:11.113864 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-fb030d8f-f98b-43e2-805a-6cb46cf4a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:11.129349 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb030d8f-f98b-43e2-805a-6cb46cf4a871 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:43:11.133362 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24d711-f5ef-4c8d-9bb9-73b9a0c01b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:43:11.133959 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d711-f5ef-4c8d-9bb9-73b9a0c01b3e service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:11.134231 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d711-f5ef-4c8d-9bb9-73b9a0c01b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:11.134527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24d711-f5ef-4c8d-9bb9-73b9a0c01b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:11.144529 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24d711-f5ef-4c8d-9bb9-73b9a0c01b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:43:11.145979 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24d711-f5ef-4c8d-9bb9-73b9a0c01b3e service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:43:11.155437 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 580/1156] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:43:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:14.799379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55994d-4bc1-4181-b48e-e76b5a5f2ad3 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:14.800279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55994d-4bc1-4181-b48e-e76b5a5f2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:14.800279 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55994d-4bc1-4181-b48e-e76b5a5f2ad3 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:14.802366 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 577/1157] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:43:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:43:14.808600 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48257b-f6ae-4dbf-943a-b112b77a6372 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:14.809056 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48257b-f6ae-4dbf-943a-b112b77a6372 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:14.809269 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48257b-f6ae-4dbf-943a-b112b77a6372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:14.836380 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-ee48257b-f6ae-4dbf-943a-b112b77a6372 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:43:14.837567 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ee48257b-f6ae-4dbf-943a-b112b77a6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:14.846712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 581/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:43:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:43:15.410283 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55994d-4bc1-4181-b48e-e76b5a5f2ad3 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:43:15.412216 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-bc55994d-4bc1-4181-b48e-e76b5a5f2ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:15.418500 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=51 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:43:15.475400 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55994d-4bc1-4181-b48e-e76b5a5f2ad3 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:43:15.479224 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75881ca0-0759-4905-afac-ea8898fa6d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5cc105367448a59da0ce5cfe60e175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:43:15.479834 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75881ca0-0759-4905-afac-ea8898fa6d05 service cinder] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:15.480118 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75881ca0-0759-4905-afac-ea8898fa6d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:15.480387 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75881ca0-0759-4905-afac-ea8898fa6d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:15.490671 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75881ca0-0759-4905-afac-ea8898fa6d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:43:15.492285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75881ca0-0759-4905-afac-ea8898fa6d05 service cinder] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:43:15.503160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 578/1159] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:43:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:17.675423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac3fa-698c-48c2-a6c5-de1bd6239be8 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:17.676301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac3fa-698c-48c2-a6c5-de1bd6239be8 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:17.676301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac3fa-698c-48c2-a6c5-de1bd6239be8 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:17.678374 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 582/1160] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 20:43:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:43:17.687246 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618e84-ad0e-4cac-8639-93d05a1eeb8e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:17.687709 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618e84-ad0e-4cac-8639-93d05a1eeb8e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:17.687885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618e84-ad0e-4cac-8639-93d05a1eeb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:17.715257 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-42618e84-ad0e-4cac-8639-93d05a1eeb8e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:43:17.716464 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-42618e84-ad0e-4cac-8639-93d05a1eeb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:17.725518 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 579/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 20:43:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:43:18.288633 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ac3fa-698c-48c2-a6c5-de1bd6239be8 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:43:18.291675 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-566ac3fa-698c-48c2-a6c5-de1bd6239be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:43:18.308424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ac3fa-698c-48c2-a6c5-de1bd6239be8 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:43:18.312253 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e477543-8e50-49d6-817e-157a18130cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5cc105367448a59da0ce5cfe60e175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:43:18.312840 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477543-8e50-49d6-817e-157a18130cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:43:18.313108 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477543-8e50-49d6-817e-157a18130cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:43:18.313370 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e477543-8e50-49d6-817e-157a18130cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:43:18.322438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e477543-8e50-49d6-817e-157a18130cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:43:18.323892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e477543-8e50-49d6-817e-157a18130cd8 service cinder] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:43:18.333351 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 583/1162] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:43:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:43:27.710105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=28 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:43:28.329340 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=42 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:31.910947 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00f21-8f0d-4519-b224-865d60bb0e8f None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:31.911549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00f21-8f0d-4519-b224-865d60bb0e8f None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:31.911549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00f21-8f0d-4519-b224-865d60bb0e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:31.920940 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03fdd5-a0b0-4dad-97a0-65cb3df8177e None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:31.921469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03fdd5-a0b0-4dad-97a0-65cb3df8177e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:31.921469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03fdd5-a0b0-4dad-97a0-65cb3df8177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:31.933639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-8ac00f21-8f0d-4519-b224-865d60bb0e8f None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:31.941106 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-6b03fdd5-a0b0-4dad-97a0-65cb3df8177e None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:31.943095 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-8ac00f21-8f0d-4519-b224-865d60bb0e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:31.943220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-6b03fdd5-a0b0-4dad-97a0-65cb3df8177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:31.951066 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 580/1163] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:31.951588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 584/1164] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:31.959514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:31.959766 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:31.959875 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:31.960042 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:31.960164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:31.960434 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:31.979929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:31.980148 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:31.981245 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:31.981383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:31.989096 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 581/1165] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:44:31.989578 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 585/1166] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:44:31.993611 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:31.993746 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.002784 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de695a9-b20e-4fa6-83d5-4c6e93469203 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.002938 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825568d0-1b1a-4dfb-899d-67b7b8483669 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.007468 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.007610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.008064 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.008185 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.008346 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.008447 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.008613 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.008715 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] PATH_INFO: `/v3/domains` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.009255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:44:32.009354 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 20:44:32.009556 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.009654 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.010645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:44:32.010645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:44:32.010645 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:44:32.011196 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.011547 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.022575 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 582/1167] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 27 20:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:44:32.028164 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 586/1168] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 27 20:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 20:44:32.030460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.030859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.040531 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fe2a6-b9b0-4067-9c6e-c8bf1d93388d admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.040704 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303eb02-51f2-4924-89a2-10bc1cecb6b1 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.045407 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.045588 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.045995 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.046159 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.046271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.046376 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.046527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.046660 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.047171 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.047282 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.048195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:44:32.048195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:44:32.048195 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:44:32.049143 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.049442 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.087637 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 583/1169] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 27 20:44:32 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:44:32.088527 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 587/1170] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 27 20:44:32 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:44:32.092179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.093313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.152987 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5533-20fe-430c-8345-58cdee648e34 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.155187 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574e7b7-f552-4cb9-b34c-efd914bf37ca admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.158357 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.159028 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.159365 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.159639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.160239 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.160382 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.160838 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.161112 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.161379 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.162006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.162261 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.163053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:44:32.163053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:44:32.163053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:44:32.164222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.189575 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 584/1171] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:44:32 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:44:32.189807 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 588/1172] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:44:32 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:44:32.191450 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.192010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.201326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4c911-3c53-47be-a1c1-87693425df42 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.201990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0bb48-6728-4a0a-a0ec-fc7b80a09f60 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.206154 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.206495 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.206772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.207047 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.207159 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.207316 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.207413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.207586 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.207956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.208225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.209544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.209809 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.219994 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 585/1174] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:44:32.220222 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 589/1174] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 20:44:32.223789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.226262 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.234475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c92a07-615f-4d41-b22b-c0bec45767b6 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.235806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8050e-0eed-49c2-8e8d-0e2aa1167b05 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.239556 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.240140 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.240417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.240700 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.240808 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.241310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.241426 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.241659 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.241922 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.242580 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.242960 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.244137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.253766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 586/1175] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:44:32.254345 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 590/1176] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 20:44:32.257950 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.258481 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.268687 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19f3a-b87b-4cea-902c-c1ae2917d18e admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.268869 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f83db-21ff-4603-9482-08943e85d374 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.273332 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e994e-f998-4ed3-97c5-add4499a3294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.273822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.273962 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e994e-f998-4ed3-97c5-add4499a3294 admin admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.274225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e994e-f998-4ed3-97c5-add4499a3294 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.274473 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.274592 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e994e-f998-4ed3-97c5-add4499a3294 admin admin] PATH_INFO: `/v3/projects/d89c2e0c50814aa3b1376d1d02e9a2bb/users/559b822033d448b09a0b31526ff66ee8/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.274795 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.275072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] PATH_INFO: `/v3/projects/2b5500a4d904469186dfb921fbd5e9fb/users/f01050e1071d462aa127a6eddd4354f3/roles/ea04e85c0aa7408095b855be56c86503` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.289548 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5500a4d904469186dfb921fbd5e9fb, user_id=f01050e1071d462aa127a6eddd4354f3, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.290132 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e994e-f998-4ed3-97c5-add4499a3294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89c2e0c50814aa3b1376d1d02e9a2bb, user_id=559b822033d448b09a0b31526ff66ee8, role_id=ea04e85c0aa7408095b855be56c86503)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.290664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:44:32.290664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:44:32.290664 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:44:32.292583 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7d4ff-74e0-4272-835d-684c32f49bd0 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.292791 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e994e-f998-4ed3-97c5-add4499a3294 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.306669 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 587/1177] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:44:32 2022] PUT /identity/v3/projects/2b5500a4d904469186dfb921fbd5e9fb/users/f01050e1071d462aa127a6eddd4354f3/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:44:32.308008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 591/1178] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:44:32 2022] PUT /identity/v3/projects/d89c2e0c50814aa3b1376d1d02e9a2bb/users/559b822033d448b09a0b31526ff66ee8/roles/ea04e85c0aa7408095b855be56c86503 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 20:44:32.311956 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.312241 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.312513 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.313070 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.313383 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.313654 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.331775 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:32.332137 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] MFA Rules not processed for user `38d5d95ae1f34880b821c1d52307fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:32.333010 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:32.333330 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:32.375479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:32.376004 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:32.394466 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 592/1179] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 20:44:32.395449 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 588/1180] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:32.404925 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.405350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:32.457770 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f77f8-aa95-423d-adf3-d8457b7aa1a0 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.458000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba194a-7059-4a4a-bd02-800e7978244b None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:32.461455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ec762-32ee-4545-9dcf-667a6a21e5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.461621 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab7213-d087-4a3a-ba97-28dcbe67ee67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:32.462389 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec762-32ee-4545-9dcf-667a6a21e5fb service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.462532 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7213-d087-4a3a-ba97-28dcbe67ee67 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:32.462682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec762-32ee-4545-9dcf-667a6a21e5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.462794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7213-d087-4a3a-ba97-28dcbe67ee67 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:32.462957 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab7213-d087-4a3a-ba97-28dcbe67ee67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.463168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec762-32ee-4545-9dcf-667a6a21e5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:32.472189 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ec762-32ee-4545-9dcf-667a6a21e5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.472311 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7213-d087-4a3a-ba97-28dcbe67ee67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:32.473655 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ec762-32ee-4545-9dcf-667a6a21e5fb service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.473769 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab7213-d087-4a3a-ba97-28dcbe67ee67 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:32.483187 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 593/1181] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:44:32.483560 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 589/1182] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:44:37.853299 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:37.854220 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:37.854686 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:37.926617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:37.927993 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:37.943730 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b255-1620-4936-be40-a603125a6bdf None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:37.944237 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b255-1620-4936-be40-a603125a6bdf None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:37.944426 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58b255-1620-4936-be40-a603125a6bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:37.989103 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-be58b255-1620-4936-be40-a603125a6bdf None None] MFA Rules not processed for user `f01050e1071d462aa127a6eddd4354f3`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:37.990272 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-be58b255-1620-4936-be40-a603125a6bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:38.031902 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 594/1183] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:37 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:38.036327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.055105 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb903e-007b-4369-b565-1a8264cec137 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.062139 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.063705 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.064199 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.064746 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.065403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.069413 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.087580 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 590/1184] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:37 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:38.091977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b255-1620-4936-be40-a603125a6bdf None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.105616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58b255-1620-4936-be40-a603125a6bdf None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.111919 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.112597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.113048 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.113326 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.114069 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.117900 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 595/1185] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 27 20:44:38 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:44:38.118052 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.119360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.172499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 591/1186] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 27 20:44:38 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:44:38.173563 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.203375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:38.208380 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb1880-e9fa-4584-b0fa-7ba2a61309f5 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.263965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:38.268904 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f5b98-71c4-47b4-810c-cf2f0b75b8b2 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.276971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.277750 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.278144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.278532 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] PATH_INFO: `/v3/users` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.279263 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.281349 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.302626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.303615 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.304051 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.304456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] PATH_INFO: `/v3/users` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.305439 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.308226 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.325828 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 592/1187] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:44:38 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 20:44:38.332133 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.345492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05730-b6ab-4483-aaa2-30eef6c40068 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.357358 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 596/1188] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 27 20:44:38 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 20:44:38.358190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.358928 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.359304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.359820 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.364255 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.365379 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.367193 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.377690 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75e87c-3960-4a00-bb21-804d3b369249 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.382656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.383271 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.383895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 593/1189] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:44:38.386695 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.387116 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.388244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.389045 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.394912 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.404285 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399ee7f-721f-4149-8966-7de89cee113e admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.410497 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 597/1190] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:44:38.412883 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.419232 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.420847 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.421435 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.421876 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] PATH_INFO: `/v3/projects/8b2516efc075461c8f53efc3e54af7d9/users/3d83a451706c483d98f176d07974900b/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.425099 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d77e-67e4-46e1-a7d8-0c6dcaf71a8b admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.430165 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.430865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.431177 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.431438 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] PATH_INFO: `/v3/projects/b855c327dac946048eec64a9699c692d/users/7982d2779ac04051b9964e95885d28d8/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.443463 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2516efc075461c8f53efc3e54af7d9, user_id=3d83a451706c483d98f176d07974900b, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.450224 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b855c327dac946048eec64a9699c692d, user_id=7982d2779ac04051b9964e95885d28d8, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.453364 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.453740 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.491424 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 594/1192] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:44:38 2022] PUT /identity/v3/projects/8b2516efc075461c8f53efc3e54af7d9/users/3d83a451706c483d98f176d07974900b/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:44:38.491652 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 598/1192] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:44:38 2022] PUT /identity/v3/projects/b855c327dac946048eec64a9699c692d/users/7982d2779ac04051b9964e95885d28d8/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 20:44:38.493525 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.493825 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.634565 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b882df-3f95-4b38-9105-f92027044d8d admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.669674 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6e6eb-a201-4edd-bd0c-9a69fe7af1d9 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.680304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.681058 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.681215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.681514 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.682143 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.684057 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.696866 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 595/1193] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 20:44:38.701369 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.714905 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8965b4-c61c-4480-af35-550e29980a6e admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.721597 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.722304 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.722721 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.722974 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] PATH_INFO: `/v3/projects/b855c327dac946048eec64a9699c692d/users/7982d2779ac04051b9964e95885d28d8/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.725044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b855c327dac946048eec64a9699c692d, user_id=7982d2779ac04051b9964e95885d28d8, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.727835 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.728683 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27e259-86c6-4942-9514-e2fc8f35eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.729758 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e259-86c6-4942-9514-e2fc8f35eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.730133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e259-86c6-4942-9514-e2fc8f35eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.730637 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27e259-86c6-4942-9514-e2fc8f35eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.731293 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27e259-86c6-4942-9514-e2fc8f35eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.733752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27e259-86c6-4942-9514-e2fc8f35eef0 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.746495 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 596/1194] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:44:38 2022] PUT /identity/v3/projects/b855c327dac946048eec64a9699c692d/users/7982d2779ac04051b9964e95885d28d8/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:44:38.746744 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 599/1195] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 27 20:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 20:44:38.754460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:38.841210 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6022cf-a05c-42e9-9f6d-6f019cacb2f4 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:38.846698 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:38.847408 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] REQUEST_METHOD: `PUT` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:38.847683 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:38.847951 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] PATH_INFO: `/v3/projects/8b2516efc075461c8f53efc3e54af7d9/users/3d83a451706c483d98f176d07974900b/roles/0f13813da5a84a44829df58f1d837465` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:38.850600 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2516efc075461c8f53efc3e54af7d9, user_id=3d83a451706c483d98f176d07974900b, role_id=0f13813da5a84a44829df58f1d837465)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:38.854673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:38.870502 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 597/1196] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 27 20:44:38 2022] PUT /identity/v3/projects/8b2516efc075461c8f53efc3e54af7d9/users/3d83a451706c483d98f176d07974900b/roles/0f13813da5a84a44829df58f1d837465 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:44:44.797260 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c8c13-fe75-4994-8f01-1abca900abcd None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:44.801021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c8c13-fe75-4994-8f01-1abca900abcd None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:44.802157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c8c13-fe75-4994-8f01-1abca900abcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:44.812467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:44.842760 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-fa0c8c13-fe75-4994-8f01-1abca900abcd None None] MFA Rules not processed for user `7982d2779ac04051b9964e95885d28d8`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:44.844326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-fa0c8c13-fe75-4994-8f01-1abca900abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:44.984912 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 600/1197] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:44 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:45.003858 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:45.005773 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:45.064348 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:45.128187 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9bf98-d476-4558-9a23-43038534815f admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:45.132965 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01102d0faa3845e0a76afc772579e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:45.133676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:45.133886 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:45.134163 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:45.230331 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:45.232151 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:45.243356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 598/1198] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:45 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:44:45.451989 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215d9b3-2667-4299-87d9-9ce88bd643f4 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:45.452301 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215d9b3-2667-4299-87d9-9ce88bd643f4 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:45.452540 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215d9b3-2667-4299-87d9-9ce88bd643f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:45.490354 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c215d9b3-2667-4299-87d9-9ce88bd643f4 None None] MFA Rules not processed for user `3d83a451706c483d98f176d07974900b`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:45.491626 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c215d9b3-2667-4299-87d9-9ce88bd643f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:45.619464 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 601/1199] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:45 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:45.636561 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:45.653455 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef18b-0e34-466d-ba09-108b9cb609e5 service glance] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:45.662054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04641014-cf04-4106-aed0-4b4b59dafde3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01102d0faa3845e0a76afc772579e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:45.663033 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04641014-cf04-4106-aed0-4b4b59dafde3 service glance] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:45.663537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04641014-cf04-4106-aed0-4b4b59dafde3 service glance] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:45.664040 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04641014-cf04-4106-aed0-4b4b59dafde3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:45.757475 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04641014-cf04-4106-aed0-4b4b59dafde3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:45.759112 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04641014-cf04-4106-aed0-4b4b59dafde3 service glance] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:45.782626 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 599/1200] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:45 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:44:54.110968 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e3cd-dc2d-4555-9d61-a5b4e6ddf754 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:54.111596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e3cd-dc2d-4555-9d61-a5b4e6ddf754 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:54.111596 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e3cd-dc2d-4555-9d61-a5b4e6ddf754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:54.131752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-a571e3cd-dc2d-4555-9d61-a5b4e6ddf754 None None] MFA Rules not processed for user `f01050e1071d462aa127a6eddd4354f3`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:54.132954 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-a571e3cd-dc2d-4555-9d61-a5b4e6ddf754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:54.140019 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 602/1201] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:44:54 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:54.432367 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764e371-54ad-47e4-8179-9b25452d7ce9 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:54.433567 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764e371-54ad-47e4-8179-9b25452d7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:54.434046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764e371-54ad-47e4-8179-9b25452d7ce9 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:54.437243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 600/1202] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 27 20:44:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:44:54.446990 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab8af-d63a-4464-a655-d2b4fd67169c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:54.447834 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab8af-d63a-4464-a655-d2b4fd67169c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:54.448328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab8af-d63a-4464-a655-d2b4fd67169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:54.486214 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-becab8af-d63a-4464-a655-d2b4fd67169c None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:54.487564 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-becab8af-d63a-4464-a655-d2b4fd67169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:54.543375 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:54.561806 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 603/1203] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 27 20:44:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:54.567071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601af6-2351-48fc-9c71-454a8eda1bc0 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:54.567350 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601af6-2351-48fc-9c71-454a8eda1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:54.567616 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e601af6-2351-48fc-9c71-454a8eda1bc0 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:54.568929 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 601/1204] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 27 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:44:54.573680 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fbd1d-0ffa-4594-b820-63fabb8d8aa0 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:54.574030 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fbd1d-0ffa-4594-b820-63fabb8d8aa0 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:54.574467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fbd1d-0ffa-4594-b820-63fabb8d8aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:54.595007 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-c27fbd1d-0ffa-4594-b820-63fabb8d8aa0 None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:54.596209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-c27fbd1d-0ffa-4594-b820-63fabb8d8aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:54.606162 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 604/1205] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 27 20:44:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:54.618432 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e601af6-2351-48fc-9c71-454a8eda1bc0 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:54.620168 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-2e601af6-2351-48fc-9c71-454a8eda1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:54.635026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e601af6-2351-48fc-9c71-454a8eda1bc0 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:54.638711 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acc847-ad9e-4ba8-abb1-586abe93c83b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01102d0faa3845e0a76afc772579e808', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:54.639394 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acc847-ad9e-4ba8-abb1-586abe93c83b service glance] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:54.639743 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acc847-ad9e-4ba8-abb1-586abe93c83b service glance] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:54.640049 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acc847-ad9e-4ba8-abb1-586abe93c83b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:54.650200 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acc847-ad9e-4ba8-abb1-586abe93c83b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:54.651819 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acc847-ad9e-4ba8-abb1-586abe93c83b service glance] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:54.662923 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 602/1206] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:44:55.044093 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc038-af90-47fd-af38-1b1f9b67b067 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.044360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc038-af90-47fd-af38-1b1f9b67b067 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.044629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc038-af90-47fd-af38-1b1f9b67b067 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.045998 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 605/1207] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 27 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:44:55.052460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab5f7-2bed-4b49-bd49-514f8c0cb0c7 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.052749 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab5f7-2bed-4b49-bd49-514f8c0cb0c7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.053072 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ab5f7-2bed-4b49-bd49-514f8c0cb0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.089623 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-3e6ab5f7-2bed-4b49-bd49-514f8c0cb0c7 None None] MFA Rules not processed for user `df9d9d38efd14328b4d6230278a49fae`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:55.090878 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-3e6ab5f7-2bed-4b49-bd49-514f8c0cb0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:55.134383 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=100 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:44:55.146467 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 603/1208] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 27 20:44:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:55.156895 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc038-af90-47fd-af38-1b1f9b67b067 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:55.169275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc038-af90-47fd-af38-1b1f9b67b067 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:55.173385 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:55.174133 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.174663 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.174998 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.183890 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:55.185467 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:55.194185 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 606/1209] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:44:55.648368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869ceba-4f0f-4d47-a556-8edfe5d84413 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.648811 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869ceba-4f0f-4d47-a556-8edfe5d84413 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.648912 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869ceba-4f0f-4d47-a556-8edfe5d84413 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.650229 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 604/1210] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 27 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:44:55.653365 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:55.655735 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1bcf-5a7e-47eb-89dc-3100d09873b7 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.658541 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1bcf-5a7e-47eb-89dc-3100d09873b7 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.659084 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1bcf-5a7e-47eb-89dc-3100d09873b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.685545 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-17ad1bcf-5a7e-47eb-89dc-3100d09873b7 None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:55.686728 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-17ad1bcf-5a7e-47eb-89dc-3100d09873b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:55.695917 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 605/1211] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 27 20:44:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:55.701591 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646373-b3e3-4817-a276-e697e036e1c8 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.701942 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646373-b3e3-4817-a276-e697e036e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.702276 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646373-b3e3-4817-a276-e697e036e1c8 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.703913 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 606/1212] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 27 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:44:55.709963 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.710323 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.710682 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.731687 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831c65c-1715-413a-a112-0bdb6e4509d9 service neutron] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:55.734297 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:44:55.735614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:55.751703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:55.751703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.751703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.751703 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.752075 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:44:55.752173 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 607/1213] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 27 20:44:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:44:55.769373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:44:55.777018 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:55.778738 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16e8cd-c219-4bb1-8fa0-8ade248af94d service placement] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:55.787497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399667e-6a4d-4773-99a0-8ae2c414ee0a None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:44:55.792424 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 607/1214] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:44:55.802816 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:44:55.803670 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:44:55.804009 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:44:55.804204 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:44:55.818136 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:44:55.820154 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:44:55.843522 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 608/1215] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:44:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:45:05.787987 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=45 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:45:05.831824 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=14 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:45:08.501425 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899957b9-e391-4d81-8f4d-617da877ae18 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:08.502004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899957b9-e391-4d81-8f4d-617da877ae18 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:08.502004 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899957b9-e391-4d81-8f4d-617da877ae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:08.526632 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-899957b9-e391-4d81-8f4d-617da877ae18 None None] MFA Rules not processed for user `df9d9d38efd14328b4d6230278a49fae`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:45:08.527892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-899957b9-e391-4d81-8f4d-617da877ae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:45:08.536008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 608/1216] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Aug 27 20:45:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:45:08.549544 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:45:08.559460 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110fec-f755-420c-ba33-ff602d3e441e service neutron] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:45:08.563215 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d5fc-e9c3-48e3-853f-aea5e562fdf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:45:08.563810 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d5fc-e9c3-48e3-853f-aea5e562fdf0 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:08.564078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d5fc-e9c3-48e3-853f-aea5e562fdf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:08.564356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d5fc-e9c3-48e3-853f-aea5e562fdf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:08.571368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d5fc-e9c3-48e3-853f-aea5e562fdf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:45:08.572801 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d5fc-e9c3-48e3-853f-aea5e562fdf0 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:45:08.580614 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 609/1217] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:45:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:45:09.281126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3fce-81a7-4923-b30a-be9716b60121 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:09.281403 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3fce-81a7-4923-b30a-be9716b60121 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:09.282242 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3fce-81a7-4923-b30a-be9716b60121 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:09.283391 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 609/1218] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:45:09.429895 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79b646-59ef-48c5-bcb2-7ca0a9624c0e None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:09.430131 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79b646-59ef-48c5-bcb2-7ca0a9624c0e None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:09.430374 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79b646-59ef-48c5-bcb2-7ca0a9624c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:09.450245 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-fd79b646-59ef-48c5-bcb2-7ca0a9624c0e None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:45:09.451499 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-fd79b646-59ef-48c5-bcb2-7ca0a9624c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:45:09.461854 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 610/1219] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:45:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:45:09.489102 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3fce-81a7-4923-b30a-be9716b60121 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:45:09.504787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3fce-81a7-4923-b30a-be9716b60121 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:45:09.510892 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88bf0-a7b8-41c4-b939-9a66f4eac106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:45:09.511369 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88bf0-a7b8-41c4-b939-9a66f4eac106 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:09.511641 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88bf0-a7b8-41c4-b939-9a66f4eac106 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:09.512088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88bf0-a7b8-41c4-b939-9a66f4eac106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:09.522111 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88bf0-a7b8-41c4-b939-9a66f4eac106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:45:09.523775 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88bf0-a7b8-41c4-b939-9a66f4eac106 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:45:09.534344 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 610/1220] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:45:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 20:45:16.296261 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63157-0d8a-46e9-a9fa-a66f4f9ff076 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:16.296767 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63157-0d8a-46e9-a9fa-a66f4f9ff076 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:16.296886 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63157-0d8a-46e9-a9fa-a66f4f9ff076 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:16.298281 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 611/1221] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:45:16.305617 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:16.306175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:16.306175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:16.332674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:45:16.333972 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:45:16.345549 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 611/1222] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:45:16.368358 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb63157-0d8a-46e9-a9fa-a66f4f9ff076 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:45:16.398434 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb63157-0d8a-46e9-a9fa-a66f4f9ff076 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:45:16.404589 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4b29c-9999-4228-909a-b8df18abdc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:45:16.405676 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4b29c-9999-4228-909a-b8df18abdc1d service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:16.405959 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4b29c-9999-4228-909a-b8df18abdc1d service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:16.406217 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4b29c-9999-4228-909a-b8df18abdc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:16.415461 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4b29c-9999-4228-909a-b8df18abdc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:45:16.417038 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4b29c-9999-4228-909a-b8df18abdc1d service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:45:16.427156 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 612/1223] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:45:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:45:26.324452 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=12 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:45:26.422901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=15 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:45:29.625022 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:45:29.635079 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3cc6-5d23-488d-8d2a-c596a069fc5e None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:45:29.639320 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff22e5-8f70-4bdb-a7eb-109fd76d38cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:45:29.639941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff22e5-8f70-4bdb-a7eb-109fd76d38cf service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:29.640215 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff22e5-8f70-4bdb-a7eb-109fd76d38cf service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:29.640479 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff22e5-8f70-4bdb-a7eb-109fd76d38cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:29.650333 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff22e5-8f70-4bdb-a7eb-109fd76d38cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:45:29.651961 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff22e5-8f70-4bdb-a7eb-109fd76d38cf service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:45:29.661587 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 612/1224] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:45:29 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:45:33.691399 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdcf56-3230-4ed1-bb49-c1c6b8174f2c None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:33.692026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdcf56-3230-4ed1-bb49-c1c6b8174f2c None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:33.692026 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdcf56-3230-4ed1-bb49-c1c6b8174f2c None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:33.693729 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 613/1225] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:45:33.700531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b8e4-198b-45fa-8aad-ed61440b0efe None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:33.701054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b8e4-198b-45fa-8aad-ed61440b0efe None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:33.701054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b8e4-198b-45fa-8aad-ed61440b0efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:33.751109 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-b7a7b8e4-198b-45fa-8aad-ed61440b0efe None None] MFA Rules not processed for user `b0822ef274eb4139ae825a9a4ef282ab`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:45:33.752867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-b7a7b8e4-198b-45fa-8aad-ed61440b0efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:45:33.765439 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 613/1226] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:45:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:45:33.781494 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdcf56-3230-4ed1-bb49-c1c6b8174f2c None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:45:33.799173 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdcf56-3230-4ed1-bb49-c1c6b8174f2c None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:45:33.805409 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015abac8-7fdd-4fa1-ab7e-58b351008cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:45:33.806046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015abac8-7fdd-4fa1-ab7e-58b351008cdd service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:33.806318 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015abac8-7fdd-4fa1-ab7e-58b351008cdd service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:33.806627 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015abac8-7fdd-4fa1-ab7e-58b351008cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:33.817091 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015abac8-7fdd-4fa1-ab7e-58b351008cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:45:33.818777 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015abac8-7fdd-4fa1-ab7e-58b351008cdd service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:45:33.830704 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 614/1227] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:45:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:45:43.745449 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=9 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:45:43.825622 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=6 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:45:45.048021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4929ed-9bf7-4f4c-a3e7-2a5e542b6c6f None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:45:45.048515 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4929ed-9bf7-4f4c-a3e7-2a5e542b6c6f None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:45:45.048610 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4929ed-9bf7-4f4c-a3e7-2a5e542b6c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:45:45.069226 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-bf4929ed-9bf7-4f4c-a3e7-2a5e542b6c6f None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:45:45.070459 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-bf4929ed-9bf7-4f4c-a3e7-2a5e542b6c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:45:45.078869 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 614/1228] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:45:45 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:45:55.062313 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:46:14.024766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371493-cc4e-44ba-8628-dac349a30c55 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:46:14.025243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371493-cc4e-44ba-8628-dac349a30c55 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:46:14.025243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38371493-cc4e-44ba-8628-dac349a30c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:46:14.044995 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-38371493-cc4e-44ba-8628-dac349a30c55 None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:46:14.046220 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-38371493-cc4e-44ba-8628-dac349a30c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:46:14.054790 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 615/1229] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:46:14 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:46:24.040306 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=3 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:46:28.653499 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80511-0779-4810-a375-6159222f3db2 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:46:28.653983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80511-0779-4810-a375-6159222f3db2 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:46:28.653983 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e80511-0779-4810-a375-6159222f3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:46:28.673712 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-49e80511-0779-4810-a375-6159222f3db2 None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:46:28.674935 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-49e80511-0779-4810-a375-6159222f3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:46:28.685027 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 615/1230] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:46:28 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:46:38.668272 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:47:29.864154 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:47:29.864657 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:47:29.864744 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:47:29.884436 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:47:29.885673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:47:29.894018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 616/1231] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:47:29 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:47:30.306217 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:47:30.306764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:47:30.306764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:47:30.362404 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] MFA Rules not processed for user `df9d9d38efd14328b4d6230278a49fae`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:47:30.363651 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:47:30.381350 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 616/1232] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 27 20:47:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:47:30.394684 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:47:30.405206 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5aee3-2b6d-4d63-aea4-2e700e1a1fef None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:47:30.409885 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:47:30.410481 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:47:30.410797 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:47:30.411054 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:47:30.418770 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:47:30.420190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:47:30.428368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 617/1233] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:47:30 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:47:40.378206 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=17 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:47:40.424736 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=9 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:47:44.153128 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:47:44.161815 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488977e6-0294-42f5-801a-092ae4a4340c None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:47:44.166104 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:47:44.166734 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:47:44.167006 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:47:44.167270 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:47:44.177647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:47:44.179157 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:47:44.189207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 617/1234] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:47:44 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:47:54.184848 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=6 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:48:51.437629 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:48:51.467332 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8459e0-1fb1-43ce-ab34-de765159ca86 service neutron] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:48:51.472901 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c562400-4cce-42ab-825d-fa9ecce07ea3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:48:51.473495 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c562400-4cce-42ab-825d-fa9ecce07ea3 service placement] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:48:51.473772 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c562400-4cce-42ab-825d-fa9ecce07ea3 service placement] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:48:51.474013 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c562400-4cce-42ab-825d-fa9ecce07ea3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:48:51.482530 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c562400-4cce-42ab-825d-fa9ecce07ea3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:48:51.484144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c562400-4cce-42ab-825d-fa9ecce07ea3 service placement] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:48:51.493822 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 618/1235] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:48:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:49:01.490101 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=10 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:49:51.049877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:49:51.071720 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01324f-c118-4e8d-9814-73137f1c18eb service neutron] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:49:51.077718 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:49:51.078412 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:49:51.078722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:49:51.078941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:49:51.087286 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:49:51.088865 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:49:51.097641 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 618/1236] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:49:51 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:49:56.086693 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] REQUEST_METHOD: `POST` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:49:56.087243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:49:56.087243 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:49:56.107044 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.auth.core [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:49:56.108239 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:49:56.115988 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 619/1237] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:49:56 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:49:56.153278 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:49:56.218274 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9d213-828f-479d-a58b-4aee44a94839 service nova] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:49:56.222167 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed5cc105367448a59da0ce5cfe60e175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:49:56.222783 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:49:56.223053 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:49:56.223297 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:49:56.234225 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:49:56.235711 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:49:56.246474 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 619/1238] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:49:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:49:57.001473 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:49:57.009275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:49:57.013497 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f956d7-845c-4063-a9f3-ec34ce244b46 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:49:57.018866 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03154707-d312-49af-8b32-687790db26a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:49:57.019010 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d8f9a-40b6-4fcb-9dbc-15b71aa21890 service cinder] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:49:57.019477 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03154707-d312-49af-8b32-687790db26a7 service placement] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:49:57.019749 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03154707-d312-49af-8b32-687790db26a7 service placement] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:49:57.020003 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03154707-d312-49af-8b32-687790db26a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:49:57.022650 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:49:57.023243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:49:57.023575 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:49:57.023846 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:49:57.028818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03154707-d312-49af-8b32-687790db26a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:49:57.030419 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03154707-d312-49af-8b32-687790db26a7 service placement] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:49:57.033248 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:49:57.034743 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:49:57.040668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 620/1239] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:49:57.044857 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 620/1240] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:49:58.864066 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03154707-d312-49af-8b32-687790db26a7 service placement] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:49:58.875747 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03154707-d312-49af-8b32-687790db26a7 service placement] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:49:58.881863 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:49:58.882617 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:49:58.882975 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:49:58.883381 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:49:58.892862 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:49:58.894571 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:49:58.905688 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 621/1241] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:49:58 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:50:07.040785 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=46 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:08.900295 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=15 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:11.245509 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:50:11.258969 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a213c95-4333-4a86-a8cd-7932f373c9d8 service neutron] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:50:11.264208 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818f4e6-2ba1-4648-9a45-d53ea3b6ec19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:50:11.265068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818f4e6-2ba1-4648-9a45-d53ea3b6ec19 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:50:11.265416 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818f4e6-2ba1-4648-9a45-d53ea3b6ec19 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:50:11.265771 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818f4e6-2ba1-4648-9a45-d53ea3b6ec19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:50:11.278057 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818f4e6-2ba1-4648-9a45-d53ea3b6ec19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:50:11.279785 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818f4e6-2ba1-4648-9a45-d53ea3b6ec19 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:50:11.293327 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 621/1242] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:50:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:50:11.389058 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:50:11.400352 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f2372-c04c-4dfd-9cc8-b026a16879a6 service nova] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:50:11.404144 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:50:11.404953 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:50:11.405250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:50:11.405673 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:50:11.414867 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:50:11.416313 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:50:11.424976 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 622/1243] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:50:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:50:16.819820 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:50:16.820341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:50:16.820341 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:50:16.839870 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] MFA Rules not processed for user `f01050e1071d462aa127a6eddd4354f3`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:50:16.841076 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:50:16.848258 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 622/1244] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:50:16 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:50:17.119609 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:50:17.128726 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c682d3-53a4-4ae0-bf6f-c86e3707562c service neutron] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:50:17.132977 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:50:17.133573 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:50:17.133851 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:50:17.134111 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:50:17.141934 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:50:17.143406 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:50:17.151971 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 623/1245] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:50:17 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:50:26.834970 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=9 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:27.148021 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=12 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:36.409331 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:50:36.439501 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c85c63-3ad9-4d0c-85e5-86e83dcae52b None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:50:36.447000 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caefe3b-1f14-4d29-b428-3eb7b4a540a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:50:36.447764 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caefe3b-1f14-4d29-b428-3eb7b4a540a9 service nova] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:50:36.448259 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caefe3b-1f14-4d29-b428-3eb7b4a540a9 service nova] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:50:36.448629 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caefe3b-1f14-4d29-b428-3eb7b4a540a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:50:36.458068 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caefe3b-1f14-4d29-b428-3eb7b4a540a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:50:36.459787 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caefe3b-1f14-4d29-b428-3eb7b4a540a9 service nova] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:50:36.470756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 623/1246] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:50:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:50:44.807250 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:50:44.816908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2508a-b9f9-4686-bd79-7eafee0ee531 service neutron] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:50:44.821752 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:50:44.822340 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:50:44.822646 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:50:44.822908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:50:44.833024 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:50:44.834492 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:50:44.844135 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 624/1247] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:50:44 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:50:46.466584 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=6 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:50:54.840102 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=6 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:05.183563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:52:05.184148 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:52:05.184148 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:52:05.204378 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] MFA Rules not processed for user `559b822033d448b09a0b31526ff66ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:52:05.205571 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:52:05.214132 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 624/1248] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 27 20:52:05 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:52:12.699039 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:52:12.712293 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dba85-2e76-4521-92bf-5d47b65dc443 service neutron] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:52:12.717684 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221667f-4041-4652-82bd-22b2d6ecfa97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:52:12.718483 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221667f-4041-4652-82bd-22b2d6ecfa97 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:52:12.718915 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221667f-4041-4652-82bd-22b2d6ecfa97 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:52:12.719179 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221667f-4041-4652-82bd-22b2d6ecfa97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:52:12.727996 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221667f-4041-4652-82bd-22b2d6ecfa97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:52:12.729570 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221667f-4041-4652-82bd-22b2d6ecfa97 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:52:12.740677 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 625/1249] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:52:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:52:15.199021 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=3 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:52:22.735648 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=6 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:12.301647 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:12.303414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:12.349550 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d90d5-d298-498b-b416-9e3c5bb1ad0e None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:12.354008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d1871-e510-466f-82e1-affe543191fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:12.354664 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d1871-e510-466f-82e1-affe543191fa service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:12.354941 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d1871-e510-466f-82e1-affe543191fa service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:12.355209 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d1871-e510-466f-82e1-affe543191fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:12.458536 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d1871-e510-466f-82e1-affe543191fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:12.460336 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d1871-e510-466f-82e1-affe543191fa service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:12.483839 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 625/1250] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:53:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:53:16.057539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ebc5-357a-4397-904d-0fdb2206dcfe None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:16.058542 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ebc5-357a-4397-904d-0fdb2206dcfe None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:16.060211 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ebc5-357a-4397-904d-0fdb2206dcfe None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:16.062716 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 626/1251] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:53:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:53:16.092616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:16.093315 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:16.093315 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:16.199772 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:53:16.202756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:16.214120 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 626/1252] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:53:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:53:16.226672 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ebc5-357a-4397-904d-0fdb2206dcfe None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:16.229486 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-c641ebc5-357a-4397-904d-0fdb2206dcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:16.246694 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ebc5-357a-4397-904d-0fdb2206dcfe None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:16.252714 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:16.253310 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:16.253595 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:16.253860 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:16.263029 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:16.264706 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:16.276303 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 627/1253] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:53:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:53:19.903054 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:19.918867 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290822a-1b5c-46f5-9fbb-3eb6d7572092 None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:19.925326 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:19.925936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:19.926212 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:19.926557 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] PATH_INFO: `/v3/users/f01050e1071d462aa127a6eddd4354f3` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:19.927859 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01050e1071d462aa127a6eddd4354f3)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:19.929910 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:19.978049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:19.981208 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01050e1071d462aa127a6eddd4354f3'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:19.982566 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01050e1071d462aa127a6eddd4354f3'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:19.992879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01050e1071d462aa127a6eddd4354f3'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.001328 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01050e1071d462aa127a6eddd4354f3'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.014432 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01050e1071d462aa127a6eddd4354f3'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.020874 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 627/1254] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 27 20:53:19 2022] DELETE /identity/v3/users/f01050e1071d462aa127a6eddd4354f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:53:20.208832 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:20.223845 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466b017-8861-4b45-a473-db9397d1b886 service placement] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:20.289650 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:20.290214 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:20.290639 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:20.290903 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] PATH_INFO: `/v3/projects/2b5500a4d904469186dfb921fbd5e9fb` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:20.292269 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5500a4d904469186dfb921fbd5e9fb)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:20.294380 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:20.352766 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5500a4d904469186dfb921fbd5e9fb', 'request_id': 'req-9e5b6c2c-2027-4f03-88ef-750d626a1a70'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.358793 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5500a4d904469186dfb921fbd5e9fb', 'request_id': 'req-9e5b6c2c-2027-4f03-88ef-750d626a1a70'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.368493 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5500a4d904469186dfb921fbd5e9fb', 'request_id': 'req-9e5b6c2c-2027-4f03-88ef-750d626a1a70'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.392662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] The token cache is being invalidate because project 2b5500a4d904469186dfb921fbd5e9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 20:53:20.392948 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.393558 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.395078 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 628/1255] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:20 2022] DELETE /identity/v3/projects/2b5500a4d904469186dfb921fbd5e9fb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:53:20.399360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:20.400768 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:20.414213 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6978d-0c04-467b-95c6-f2006bce1481 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:20.474373 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:20.475037 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:20.475316 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:20.475588 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] PATH_INFO: `/v3/users/3d83a451706c483d98f176d07974900b` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:20.476725 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d83a451706c483d98f176d07974900b)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:20.478709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:20.530080 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d83a451706c483d98f176d07974900b'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.530906 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d83a451706c483d98f176d07974900b'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.539441 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d83a451706c483d98f176d07974900b'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.546905 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d83a451706c483d98f176d07974900b'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.560468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d83a451706c483d98f176d07974900b'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.567690 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 628/1256] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 27 20:53:20 2022] DELETE /identity/v3/users/3d83a451706c483d98f176d07974900b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:53:20.754459 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:20.756021 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:20.774748 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b6c2c-2027-4f03-88ef-750d626a1a70 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:20.847178 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:20.847740 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:20.848018 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:20.848287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] PATH_INFO: `/v3/projects/8b2516efc075461c8f53efc3e54af7d9` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:20.849470 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2516efc075461c8f53efc3e54af7d9)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:20.851465 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:20.859669 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:20.906534 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2516efc075461c8f53efc3e54af7d9', 'request_id': 'req-002421af-48f6-4c27-bdf6-c8d81b6b69a1'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.913043 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2516efc075461c8f53efc3e54af7d9', 'request_id': 'req-002421af-48f6-4c27-bdf6-c8d81b6b69a1'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.920674 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2516efc075461c8f53efc3e54af7d9', 'request_id': 'req-002421af-48f6-4c27-bdf6-c8d81b6b69a1'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.932991 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] The token cache is being invalidate because project 8b2516efc075461c8f53efc3e54af7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 20:53:20.933280 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.933920 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:53:20.935598 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 629/1257] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 27 20:53:20 2022] DELETE /identity/v3/projects/8b2516efc075461c8f53efc3e54af7d9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:53:30.563516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:30.929764 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:53:56.681151 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:53:56.682709 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:56.758411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacbac4-0514-4592-a995-769e537f3e18 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:53:56.825175 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:53:56.825777 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:53:56.826049 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:53:56.826318 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:53:56.828414 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:53:56.839829 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:53:56.841411 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:53:56.851088 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 629/1258] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:53:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:54:06.847275 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=58 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:54:50.792075 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:54:50.793742 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:54:50.864501 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002421af-48f6-4c27-bdf6-c8d81b6b69a1 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:54:50.869908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0822ef274eb4139ae825a9a4ef282ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:54:50.870537 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:54:50.870813 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:54:50.872668 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:54:50.878539 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:54:50.961045 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:54:50.962662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec747629-a255-4530-9d6a-c8a00d3f8119 service nova] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:54:50.981368 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 630/1259] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:54:50 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:54:55.226207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:54:55.227753 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:54:55.297909 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d65d5-1c5d-4346-8613-f336dcddf4b9 service placement] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:54:55.301469 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9d9d38efd14328b4d6230278a49fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:54:55.302074 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:54:55.302322 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:54:55.302656 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:54:55.304722 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:54:55.379587 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:54:55.381033 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140547ec-0c9a-48e1-b433-01e2267533a1 service neutron] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:54:55.390777 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 630/1260] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:54:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:55:00.978806 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=67 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:01.390678 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e662c2-728c-42bf-ac3f-d75a0c067060 None None] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.391032 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e662c2-728c-42bf-ac3f-d75a0c067060 None None] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.391402 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e662c2-728c-42bf-ac3f-d75a0c067060 None None] PATH_INFO: `/` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.392859 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 631/1261] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 27 20:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 20:55:01.422936 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0efb-a328-4d1d-bda1-71f1ff919990 None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.423468 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0efb-a328-4d1d-bda1-71f1ff919990 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.423616 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d0efb-a328-4d1d-bda1-71f1ff919990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.446008 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-541d0efb-a328-4d1d-bda1-71f1ff919990 None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:55:01.447516 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-541d0efb-a328-4d1d-bda1-71f1ff919990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:55:01.456417 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e662c2-728c-42bf-ac3f-d75a0c067060 None None] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:55:01.458511 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-16e662c2-728c-42bf-ac3f-d75a0c067060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:55:01.463742 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 631/1262] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 27 20:55:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:55:01.479277 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755abf-a3c0-4c1a-8220-fcdb6a18a806 None None] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.479438 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e662c2-728c-42bf-ac3f-d75a0c067060 None None] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:55:01.479927 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755abf-a3c0-4c1a-8220-fcdb6a18a806 None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.480456 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27755abf-a3c0-4c1a-8220-fcdb6a18a806 None None] PATH_INFO: `/` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.482391 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 632/1263] 10.222.0.15 () {54 vars in 961 bytes} [Sat Aug 27 20:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 20:55:01.485502 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:55:01.486908 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.487176 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.487452 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] PATH_INFO: `/v3/users/559b822033d448b09a0b31526ff66ee8` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.487794 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] REQUEST_METHOD: `POST` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.488078 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.488345 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.488789 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=559b822033d448b09a0b31526ff66ee8)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:55:01.489818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: WARNING py.warnings [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:55:01.489818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: warnings.warn(msg) Aug 27 20:55:01.489818 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: Aug 27 20:55:01.491356 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:55:01.509111 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.auth.core [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] MFA Rules not processed for user `854747c422b8470bbb434bdf95cc791a`. Rule list: `[]` (Enabled: `True`). {{(pid=94819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 20:55:01.510312 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:55:01.519655 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 633/1264] 10.222.0.15 () {58 vars in 1058 bytes} [Sat Aug 27 20:55:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 20:55:01.526934 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:55:01.537594 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14e86-1601-41ef-8d4f-eb9263b1bbee None None] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:55:01.543774 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:55:01.544754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] REQUEST_METHOD: `GET` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.544754 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.545080 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.554740 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:55:01.556955 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:55:01.568563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 634/1265] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:55:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:55:01.568774 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559b822033d448b09a0b31526ff66ee8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.569474 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559b822033d448b09a0b31526ff66ee8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.580061 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559b822033d448b09a0b31526ff66ee8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.595023 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559b822033d448b09a0b31526ff66ee8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.620046 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559b822033d448b09a0b31526ff66ee8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.628593 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 632/1266] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 27 20:55:01 2022] DELETE /identity/v3/users/559b822033d448b09a0b31526ff66ee8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:55:01.819217 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:55:01.830128 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429378-c06b-45e8-8990-8c3826eb782c service placement] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:55:01.893098 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:55:01.893779 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:01.894122 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:01.894521 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] PATH_INFO: `/v3/projects/d89c2e0c50814aa3b1376d1d02e9a2bb` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:01.895805 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89c2e0c50814aa3b1376d1d02e9a2bb)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:55:01.897150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: WARNING py.warnings [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 20:55:01.897150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: warnings.warn(msg) Aug 27 20:55:01.897150 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: Aug 27 20:55:01.898360 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:55:01.916879 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=100 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:01.960885 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89c2e0c50814aa3b1376d1d02e9a2bb', 'request_id': 'req-ab94de85-0cba-43b7-b4e2-75ea0537a625'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.968207 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89c2e0c50814aa3b1376d1d02e9a2bb', 'request_id': 'req-ab94de85-0cba-43b7-b4e2-75ea0537a625'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:01.984756 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89c2e0c50814aa3b1376d1d02e9a2bb', 'request_id': 'req-ab94de85-0cba-43b7-b4e2-75ea0537a625'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.006780 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] The token cache is being invalidate because project d89c2e0c50814aa3b1376d1d02e9a2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 20:55:02.007039 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.007752 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.009284 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 635/1267] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 27 20:55:01 2022] DELETE /identity/v3/projects/d89c2e0c50814aa3b1376d1d02e9a2bb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:55:02.013471 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:55:02.014998 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:55:02.028287 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f68c-e38f-4083-bd9c-6a7a380412ab admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:55:02.087071 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:55:02.087713 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:02.087987 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:02.088263 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] PATH_INFO: `/v3/users/7982d2779ac04051b9964e95885d28d8` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:02.102373 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7982d2779ac04051b9964e95885d28d8)` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:55:02.104378 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:55:02.163739 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7982d2779ac04051b9964e95885d28d8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.164467 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7982d2779ac04051b9964e95885d28d8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.173030 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7982d2779ac04051b9964e95885d28d8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.180549 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7982d2779ac04051b9964e95885d28d8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.181852 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:02.195485 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.notifications [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7982d2779ac04051b9964e95885d28d8'} {{(pid=94818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.202345 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 633/1268] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 27 20:55:02 2022] DELETE /identity/v3/users/7982d2779ac04051b9964e95885d28d8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:55:02.384531 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Authenticating user token {{(pid=94819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:55:02.386170 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.fernet_utils [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:55:02.398741 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94de85-0cba-43b7-b4e2-75ea0537a625 admin admin] Validating token access rules against request {{(pid=94819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:55:02.456475 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d5d95ae1f34880b821c1d52307fcc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff777f39d5941018014cff100fff5ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:55:02.457183 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:55:02.457356 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:55:02.457642 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] PATH_INFO: `/v3/projects/b855c327dac946048eec64a9699c692d` {{(pid=94819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:55:02.468877 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b855c327dac946048eec64a9699c692d)` {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:55:02.470860 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] RBAC: Authorization granted {{(pid=94819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:55:02.522563 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b855c327dac946048eec64a9699c692d', 'request_id': 'req-5ad066b8-44e9-4d1c-9cec-b2863c819b30'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.528309 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b855c327dac946048eec64a9699c692d', 'request_id': 'req-5ad066b8-44e9-4d1c-9cec-b2863c819b30'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.537243 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b855c327dac946048eec64a9699c692d', 'request_id': 'req-5ad066b8-44e9-4d1c-9cec-b2863c819b30'} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.549136 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] The token cache is being invalidate because project b855c327dac946048eec64a9699c692d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 20:55:02.549423 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.550126 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG keystone.notifications [None req-5ad066b8-44e9-4d1c-9cec-b2863c819b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 20:55:02.551674 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: [pid: 94819|app: 0|req: 636/1269] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 27 20:55:02 2022] DELETE /identity/v3/projects/b855c327dac946048eec64a9699c692d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 20:55:12.199105 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:55:12.546066 dv-osbrick-master-4-ceph devstack@keystone.service[94819]: DEBUG dbcounter [-] [94819] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=94819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 20:59:00.714630 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Authenticating user token {{(pid=94818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 20:59:00.716160 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:59:00.795798 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929541ee-cada-4bff-90d3-e5667e9c3210 admin admin] Validating token access rules against request {{(pid=94818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 20:59:00.855065 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854747c422b8470bbb434bdf95cc791a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f613b43f593f478195796a930df05d6c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 20:59:00.855662 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] REQUEST_METHOD: `GET` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 20:59:00.855931 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] SCRIPT_NAME: `/identity` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 20:59:00.856190 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 20:59:00.858058 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.fernet_utils [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 20:59:00.868854 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 20:59:00.870414 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342c864-1fcf-42ca-af39-c8d8e8196ea2 service placement] RBAC: Authorization granted {{(pid=94818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 20:59:00.879897 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: [pid: 94818|app: 0|req: 634/1270] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 27 20:59:00 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 20:59:10.876244 dv-osbrick-master-4-ceph devstack@keystone.service[94818]: DEBUG dbcounter [-] [94818] Writing DB stats keystone:SELECT=62 {{(pid=94818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}